Jul 18 05:51:38 devstack cinder-volume[76090]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 18 05:51:38 devstack cinder-volume[76090]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 18 05:51:38 devstack cinder-volume[76090]: we strongly recommend against using it for new projects. Jul 18 05:51:38 devstack cinder-volume[76090]: If you are already using Eventlet, we recommend migrating to a different Jul 18 05:51:38 devstack cinder-volume[76090]: framework. For more detail see Jul 18 05:51:38 devstack cinder-volume[76090]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 18 05:51:38 devstack cinder-volume[76090]: import eventlet # noqa Jul 18 05:51:41 devstack cinder-volume[76090]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76090) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:51:41 devstack cinder-volume[76090]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76090) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:51:41 devstack cinder-volume[76090]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76090) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:51:42 devstack cinder-volume[76090]: INFO dbcounter [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Registered counter for database cinder Jul 18 05:51:42 devstack cinder-volume[76090]: DEBUG oslo_db.sqlalchemy.engines [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76090) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:51:42 devstack cinder-volume[76090]: DEBUG dbcounter [-] [76090] Writer thread running {{(pid=76090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 18 05:51:42 devstack cinder-volume[76090]: INFO cinder.rpc [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 18 05:51:42 devstack cinder-volume[76090]: INFO cinder.rpc [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 18 05:51:42 devstack cinder-volume[76090]: DEBUG oslo_db.sqlalchemy.engines [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76090) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:51:42 devstack cinder-volume[76090]: INFO cinder.volume.manager [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Determined volume DB was empty at startup. Jul 18 05:51:42 devstack cinder-volume[76090]: DEBUG cinder.volume.manager [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76090) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 18 05:51:42 devstack cinder-volume[76090]: INFO cinder.volume.manager [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 18 05:51:42 devstack cinder-volume[76090]: WARNING stevedore.named [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 18 05:51:42 devstack cinder-volume[76090]: WARNING castellan.key_manager [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:51:42 devstack cinder-volume[76090]: WARNING cinder.keymgr.conf_key_mgr [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:51:42 devstack cinder-volume[76090]: DEBUG cinder.volume.drivers.lvm [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76090) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 18 05:51:42 devstack cinder-volume[76090]: DEBUG oslo_concurrency.processutils [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_concurrency.processutils [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] CMD "cinder-rtstool verify" returned: 0 in 0.426s {{(pid=76090) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_db.sqlalchemy.engines [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76090) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:51:43 devstack cinder-volume[76090]: INFO cinder.rpc [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 18 05:51:43 devstack cinder-volume[76090]: INFO cinder.rpc [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 18 05:51:43 devstack cinder-volume[76090]: WARNING stevedore.named [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 18 05:51:43 devstack cinder-volume[76090]: WARNING castellan.key_manager [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:51:43 devstack cinder-volume[76090]: INFO cinder.volume.manager [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_db.sqlalchemy.engines [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76090) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:51:43 devstack cinder-volume[76090]: INFO oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Starting 1 workers Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Started child 76243 {{(pid=76090) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Full set of CONF: {{(pid=76090) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] ******************************************************************************** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Configuration options gathered from: {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] ================================================================================ {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] allow_availability_zone_fallback = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] allow_compression_on_image_upload = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] allowed_direct_url_schemes = [] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] api_rate_limit = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] auth_strategy = keystone {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] az_cache_duration = 3600 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_availability_zone = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_host = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_name = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_stats_polling_interval = 60 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backup_api_class = cinder.backup.api.API {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backup_name_template = backup-%s {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backup_use_same_host = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backup_use_temp_snapshot = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76243]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] chap_password = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] chap_username = {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cinder_internal_tenant_project_id = 62f275389a274aa39fb01af75803eb7f {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cinder_internal_tenant_user_id = 9bf8be2ddd614c9989fea17926232cb1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cloned_volume_same_az = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cluster = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] compression_format = gzip {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] compute_api_class = cinder.compute.nova.API {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] config_dir = [] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] config_source = [] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] control_exchange = openstack {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] debug = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] default_availability_zone = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] default_group_type = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] default_volume_type = lvmdriver-1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] disk_geometry = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] driver_client_cert = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] driver_client_cert_key = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] driver_data_namespace = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] driver_ssl_cert_path = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] driver_ssl_cert_verify = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] driver_use_ssl = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] enable_force_upload = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] enable_new_services = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] enable_unsupported_driver = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] enabled_backends = ['lvmdriver-1'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] enforce_multipath_for_image_xfer = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] filter_function = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance_api_insecure = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance_api_servers = ['http://192.168.122.94/image'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance_api_ssl_compression = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance_ca_certificates_file = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance_catalog_info = image:glance:publicURL {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance_certfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance_keyfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance_num_retries = 3 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance_request_timeout = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] goodness_function = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] graceful_shutdown_timeout = 5 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] group_api_class = cinder.group.api.API {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] host = devstack {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] image_compress_on_upload = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] image_conversion_address_space_limit = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] image_conversion_cpu_limit = 60 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] image_conversion_disable = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] image_upload_use_cinder_backend = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] image_upload_use_internal_tenant = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] image_volume_cache_enabled = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] image_volume_cache_max_count = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] image_volume_cache_max_size_gb = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] init_host_max_objects_retrieval = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] instance_format = [instance: %(uuid)s] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] iscsi_target_flags = {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] iscsi_write_cache = on {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] iser_helper = tgtadm {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] iser_ip_address = 192.168.122.94 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] iser_port = 3260 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] log_color = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] log_config_append = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] log_dir = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] log_file = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] log_options = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] log_rotate_interval = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] log_rotate_interval_type = days {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] log_rotation_type = none {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] max_age = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] max_logfile_count = 30 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] max_logfile_size_mb = 200 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] max_over_subscription_ratio = 20.0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] message_reap_interval = 86400 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] message_ttl = 2592000 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] migration_create_volume_timeout_secs = 300 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] monkey_patch = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] monkey_patch_modules = [] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] my_ip = 192.168.122.94 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] no_snapshot_gb_quota = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] num_iser_scan_tries = 3 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] num_shell_tries = 3 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] num_volume_device_scan_tries = 3 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] nvmeof_conn_info_version = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] nvmet_ns_id = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] nvmet_port_id = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] osapi_max_limit = 1000 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] osapi_volume_ext_list = [] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] osapi_volume_listen = 0.0.0.0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] osapi_volume_listen_port = 8776 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] osapi_volume_use_ssl = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] osapi_volume_workers = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] per_volume_size_limit = -1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] periodic_fuzzy_delay = 60 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] periodic_interval = 60 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] project_id_regex = [0-9a-f\-]+ {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] public_endpoint = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] publish_errors = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] quota_backup_gigabytes = 1000 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] quota_backups = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] quota_gigabytes = 1000 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] quota_groups = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] quota_snapshots = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] quota_volumes = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] rate_limit_burst = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] rate_limit_except_level = CRITICAL {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] rate_limit_interval = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] reinit_driver_count = 3 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] replication_device = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] report_discard_supported = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] report_interval = 120 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] reservation_clean_interval = 86400 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] reservation_expire = 86400 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] reserved_image_namespaces = [] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] reserved_percentage = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] rpc_response_timeout = 120 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] run_external_periodic_tasks = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] scst_target_driver = iscsi {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] scst_target_iqn_name = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] service_down_time = 720 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] shell_completion = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] snapshot_name_template = snapshot-%s {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] snapshot_same_host = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] split_loggers = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] state_path = /opt/stack/data/cinder {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] storage_availability_zone = nova {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] storage_protocol = iSCSI {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] syslog_log_facility = LOG_USER {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] target_helper = lioadm {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] target_ip_address = 192.168.122.94 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] target_port = 3260 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] target_protocol = iscsi {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] target_secondary_ip_addresses = [] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] trace_flags = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] transfer_api_class = cinder.transfer.api.API {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] transport_url = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] until_refresh = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] use_chap_auth = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] use_default_quota_class = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] use_journal = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] use_json = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] use_multipath_for_image_xfer = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] use_stderr = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] use_syslog = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] verify_glance_signatures = enabled {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volume_api_class = cinder.volume.api.API {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volume_backend_name = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volume_clear = zero {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volume_clear_ionice = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volume_clear_size = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volume_copy_bps_limit = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volume_dd_blocksize = 1M {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76243]: INFO cinder.volume.manager [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 18 05:51:43 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volume_name_template = volume-%s {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volume_service_inithost_offload = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volume_usage_audit_period = month {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] zoning_mode = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_concurrency.disable_process_locking = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.auth_section = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.auth_type = password {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.auth_version = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.cache = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.certfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.delay_auth_decision = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.http_connect_timeout = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.include_service_catalog = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.insecure = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.interface = public {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.keyfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_password = {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcache_username = {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.region_name = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.service_token_roles_required = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.service_type = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.token_cache_time = 300 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.94/identity {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.backend = dogpile.cache.null {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.backend_argument = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.backend_expiration_time = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.config_prefix = cache.oslo {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.debug_cache_backend = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.enable_retry_client = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.enable_socket_keepalive = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.enabled = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.expiration_time = 600 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.hashclient_retry_attempts = 2 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.memcache_dead_retry = 300 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.memcache_pool_maxsize = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.memcache_sasl_enabled = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.password = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.proxies = [] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.redis_db = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.redis_sentinel_service_name = mymaster {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.redis_server = localhost:6379 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.retry_attempts = 2 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.retry_delay = 0.0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.socket_keepalive_count = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.socket_keepalive_idle = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.socket_keepalive_interval = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.socket_timeout = 1.0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.tls_allowed_ciphers = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.tls_cafile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.tls_certfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.tls_enabled = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.tls_keyfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cache.username = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] coordination.backend_url = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.asyncio_connection = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.asyncio_slave_connection = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.backend = sqlalchemy {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.connection = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.connection_debug = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.connection_parameters = {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.connection_recycle_time = 3600 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.connection_trace = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.db_inc_retry_interval = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.db_max_retries = 20 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.db_max_retry_interval = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.db_retry_interval = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.max_overflow = 50 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.max_pool_size = 5 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.max_retries = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.mysql_wsrep_sync_wait = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.pool_timeout = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.retry_interval = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.slave_connection = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.sqlite_synchronous = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.synchronous_reader = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] database.use_db_reconnect = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler.connection_string = messaging:// {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler.enabled = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler.es_doc_type = notification {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler.es_scroll_size = 10000 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler.es_scroll_time = 2m {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler.filter_error_trace = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler.hmac_keys = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler.sentinel_service_name = mymaster {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler.socket_timeout = 0.1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler.trace_requests = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler.trace_sqlalchemy = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler_jaeger.process_tags = {} {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler_jaeger.service_name_prefix = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] profiler_otlp.service_name_prefix = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_policy.enforce_new_defaults = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_policy.policy_default_rule = default {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_policy.policy_file = policy.yaml {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_policy.remote_timeout = 60.0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] privsep_osbrick.group = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] privsep_osbrick.helper_command = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] privsep_osbrick.user = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cinder_sys_admin.group = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cinder_sys_admin.helper_command = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] cinder_sys_admin.user = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] service_user.auth_section = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] service_user.auth_type = password {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] service_user.cafile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] service_user.certfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] service_user.collect_timing = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] service_user.insecure = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] service_user.keyfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] service_user.send_service_user_token = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] service_user.split_loggers = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] service_user.timeout = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance.auth_section = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance.auth_type = password {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance.certfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance.collect_timing = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance.insecure = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance.keyfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance.region_name = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance.split_loggers = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] glance.timeout = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.backend_availability_zone = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.chap_password = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.chap_username = {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.disk_geometry = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.driver_client_cert = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.driver_client_cert_key = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.driver_data_namespace = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.driver_use_ssl = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.enable_unsupported_driver = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.extra_capabilities = {} {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.filter_function = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.goodness_function = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.iscsi_target_flags = {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.iscsi_write_cache = on {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.iser_helper = tgtadm {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.iser_ip_address = 192.168.122.94 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.iser_port = 3260 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.lvm_mirrors = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.lvm_share_target = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.lvm_type = auto {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.num_shell_tries = 3 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.nvmet_port_id = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.replication_device = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.report_discard_supported = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.reserved_percentage = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.scst_target_driver = iscsi {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.scst_target_iqn_name = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.storage_protocol = iSCSI {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.target_helper = tgtadm {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.target_ip_address = 192.168.122.94 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.target_port = 3260 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.target_protocol = iscsi {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.trace_flags = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.unique_fqdn_network = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.use_chap_auth = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.volume_backend_name = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.volume_clear = zero {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.volume_clear_ionice = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.volume_clear_size = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.volume_group = cinder-volumes {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_reports.file_event_handler = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_reports.log_dir = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.backend_availability_zone = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.backend_host = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.chap_password = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.chap_username = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.chiscsi_conf = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.disk_geometry = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.driver_client_cert = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.driver_data_namespace = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.driver_use_ssl = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.extra_capabilities = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.filter_function = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.goodness_function = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.iser_helper = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.iser_ip_address = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.iser_port = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.iser_target_prefix = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.lvm_conf_file = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.lvm_mirrors = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.lvm_share_target = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.lvm_type = auto {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.num_shell_tries = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.nvmet_port_id = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.replication_device = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.report_discard_supported = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.reserved_percentage = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.scst_target_driver = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.storage_protocol = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.target_helper = lioadm {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.target_ip_address = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.target_port = 3260 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.target_protocol = iscsi {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.trace_flags = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.use_chap_auth = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.volume_clear = zero {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.volume_clear_size = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] lvmdriver-1.volumes_dir = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack sudo[76247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack sudo[76247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.ssl = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.ssl_version = {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_notifications.driver = [] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_notifications.retry = -1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] oslo_messaging_notifications.transport_url = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] key_manager.fixed_key = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.barbican_api_version = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.barbican_endpoint = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.barbican_endpoint_type = public {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.barbican_region_name = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.cafile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.certfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.collect_timing = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.insecure = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.keyfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.number_of_retries = 60 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.retry_delay = 1 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.send_service_user_token = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.split_loggers = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.timeout = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.verify_ssl = True {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican.verify_ssl_path = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican_service_user.auth_section = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican_service_user.auth_type = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican_service_user.cafile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican_service_user.certfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican_service_user.collect_timing = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican_service_user.insecure = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican_service_user.keyfile = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican_service_user.split_loggers = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] barbican_service_user.timeout = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.approle_role_id = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.approle_secret_id = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.auth_method = approle {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.auth_path = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.kv_mountpoint = secret {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.kv_path = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.kv_version = 2 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.namespace = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.root_token_id = **** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.ssl_ca_crt_file = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.timeout = 60.0 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.token_file = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.token_role = None {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.use_ssl = False {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:51:43 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] ******************************************************************************** {{(pid=76090) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 18 05:51:44 devstack sudo[76247]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:44 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.356s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:44 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:44 devstack sudo[76251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:51:44 devstack sudo[76251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:44 devstack sudo[76251]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:44 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.345s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:44 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 05:51:44 devstack cinder-volume[76243]: INFO cinder.brick.local_dev.lvm [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 18 05:51:44 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:44 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:44 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:44 devstack sudo[76317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:51:44 devstack sudo[76317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:44 devstack sudo[76317]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:44 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:44 devstack cinder-volume[76243]: DEBUG cinder.brick.local_dev.lvm [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76243) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 18 05:51:44 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:44 devstack sudo[76441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:51:44 devstack sudo[76441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:45 devstack sudo[76441]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:45 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.486s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:45 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:45 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:45 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:45 devstack sudo[76618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:51:45 devstack sudo[76618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:45 devstack sudo[76618]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:45 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:45 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:45 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:45 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:45 devstack sudo[76710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 18 05:51:45 devstack sudo[76710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:45 devstack sudo[76710]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:45 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.254s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:45 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:45 devstack sudo[76783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:51:45 devstack sudo[76783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:46 devstack sudo[76783]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:46 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:46 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:46 devstack sudo[76864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:51:46 devstack sudo[76864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:46 devstack sudo[76864]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:46 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:46 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:46 devstack sudo[76871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:51:46 devstack sudo[76871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:46 devstack sudo[76871]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:46 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:46 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:46 devstack sudo[76950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:51:46 devstack sudo[76950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:46 devstack sudo[76950]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:46 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:46 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:47 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:47 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:47 devstack sudo[76954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:51:47 devstack sudo[76954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:47 devstack sudo[76954]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:47 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:47 devstack cinder-volume[76243]: INFO cinder.volume.drivers.lvm [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 18 05:51:47 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:47 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:47 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:47 devstack sudo[77037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:51:47 devstack sudo[77037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:47 devstack sudo[77037]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:47 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:47 devstack cinder-volume[76243]: DEBUG cinder.volume.drivers.lvm [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Updating volume stats {{(pid=76243) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:51:47 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:47 devstack sudo[77047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:51:47 devstack sudo[77047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:47 devstack sudo[77047]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:47 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:47 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:47 devstack sudo[77056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:51:47 devstack sudo[77056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:48 devstack sudo[77056]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:48 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:48 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:48 devstack sudo[77059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:51:48 devstack sudo[77059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:48 devstack sudo[77059]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:48 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:48 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:48 devstack sudo[77062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:51:48 devstack sudo[77062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:48 devstack sudo[77062]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:48 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:48 devstack cinder-volume[76243]: INFO cinder.volume.driver [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Driver hasn't implemented _init_vendor_properties() Jul 18 05:51:48 devstack cinder-volume[76243]: DEBUG cinder.volume.driver [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76243) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 18 05:51:48 devstack cinder-volume[76243]: DEBUG oslo_db.sqlalchemy.engines [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76243) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:51:48 devstack cinder-volume[76243]: DEBUG dbcounter [-] [76243] Writer thread running {{(pid=76243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 18 05:51:48 devstack cinder-volume[76243]: DEBUG cinder.db.api [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Building query based on filter {{(pid=76243) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 18 05:51:48 devstack cinder-volume[76243]: DEBUG cinder.image.image_utils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76243) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 18 05:51:48 devstack cinder-volume[76243]: INFO cinder.keymgr.migration [None req-95cabe47-5037-4e91-baf1-4f9a4ea0c148 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 18 05:51:48 devstack cinder-volume[76243]: DEBUG cinder.volume.drivers.lvm [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Updating volume stats {{(pid=76243) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:51:48 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:48 devstack sudo[77066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:51:48 devstack sudo[77066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:49 devstack sudo[77066]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:49 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:49 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:49 devstack sudo[77069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:51:49 devstack sudo[77069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:49 devstack sudo[77069]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:49 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:49 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:49 devstack sudo[77073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:51:49 devstack sudo[77073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:49 devstack sudo[77073]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:49 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:49 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:49 devstack sudo[77078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:51:49 devstack sudo[77078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:49 devstack sudo[77078]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:49 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:49 devstack cinder-volume[76243]: DEBUG cinder.manager [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Notifying Schedulers of capabilities ... {{(pid=76243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:51:49 devstack cinder-volume[76243]: INFO cinder.volume.manager [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Driver initialization completed successfully. Jul 18 05:51:49 devstack cinder-volume[76243]: INFO cinder.manager [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Initiating service 2 cleanup Jul 18 05:51:49 devstack cinder-volume[76243]: INFO cinder.manager [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Service 2 cleanup completed. Jul 18 05:51:49 devstack cinder-volume[76243]: DEBUG cinder.service [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Creating RPC server for service cinder-volume {{(pid=76243) start /opt/stack/cinder/cinder/service.py:231}} Jul 18 05:51:50 devstack cinder-volume[76243]: DEBUG cinder.service [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76243) start /opt/stack/cinder/cinder/service.py:237}} Jul 18 05:51:50 devstack cinder-volume[76243]: INFO cinder.volume.manager [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 18 05:51:50 devstack cinder-volume[76243]: DEBUG cinder.volume.drivers.lvm [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Updating volume stats {{(pid=76243) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:51:50 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:50 devstack sudo[77081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:51:50 devstack sudo[77081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:50 devstack sudo[77081]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:50 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:50 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:50 devstack sudo[77086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:51:50 devstack sudo[77086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:50 devstack sudo[77086]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:50 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:50 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:50 devstack sudo[77089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:51:50 devstack sudo[77089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:50 devstack sudo[77089]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:50 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:50 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:51:50 devstack sudo[77092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:51:50 devstack sudo[77092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:51:51 devstack sudo[77092]: pam_unix(sudo:session): session closed for user root Jul 18 05:51:51 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:51:51 devstack cinder-volume[76243]: INFO cinder.volume.manager [None req-a0af9178-b654-4c99-9d91-9c54ce621c49 None None] Driver post RPC initialization completed successfully. Jul 18 05:51:53 devstack cinder-volume[76090]: DEBUG dbcounter [-] [76090] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76090) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:52:01 devstack cinder-volume[76243]: DEBUG dbcounter [-] [76243] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:52:01 devstack cinder-volume[76243]: DEBUG dbcounter [-] [76243] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:52:07 devstack cinder-volume[76243]: DEBUG oslo_service.periodic_task [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running periodic task VolumeManager._thread_info {{(pid=76243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:52:07 devstack cinder-volume[76243]: DEBUG cinder.volume.manager [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] thread count: 6 {{(pid=76243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:52:07 devstack cinder-volume[76243]: DEBUG cinder.volume.manager [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] thread info: [<_MainThread(MainThread, started 129532145946752)>, , , , , ] {{(pid=76243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:53:07 devstack cinder-volume[76243]: DEBUG oslo_service.periodic_task [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:53:07 devstack cinder-volume[76243]: DEBUG cinder.volume.drivers.lvm [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Updating volume stats {{(pid=76243) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:53:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:07 devstack sudo[79699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:53:07 devstack sudo[79699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:07 devstack sudo[79699]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:07 devstack sudo[79702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:53:07 devstack sudo[79702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:07 devstack sudo[79702]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:07 devstack sudo[79705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:53:07 devstack sudo[79705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:07 devstack sudo[79705]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:53:08 devstack sudo[79708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:53:08 devstack sudo[79708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:53:08 devstack sudo[79708]: pam_unix(sudo:session): session closed for user root Jul 18 05:53:08 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:53:08 devstack cinder-volume[76243]: DEBUG cinder.manager [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Notifying Schedulers of capabilities ... {{(pid=76243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:53:08 devstack cinder-volume[76243]: DEBUG oslo_service.periodic_task [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running periodic task VolumeManager._thread_info {{(pid=76243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:53:08 devstack cinder-volume[76243]: DEBUG cinder.volume.manager [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] thread count: 6 {{(pid=76243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:53:08 devstack cinder-volume[76243]: DEBUG cinder.volume.manager [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] thread info: [<_MainThread(MainThread, started 129532145946752)>, , , , , ] {{(pid=76243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:54:01 devstack cinder-volume[76243]: DEBUG dbcounter [-] [76243] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:54:07 devstack cinder-volume[76243]: DEBUG oslo_service.periodic_task [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:54:07 devstack cinder-volume[76243]: DEBUG cinder.volume.drivers.lvm [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Updating volume stats {{(pid=76243) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:54:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:07 devstack sudo[82694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:54:07 devstack sudo[82694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:07 devstack sudo[82694]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:07 devstack sudo[82701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:54:07 devstack sudo[82701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:07 devstack sudo[82701]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:07 devstack sudo[82705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:54:07 devstack sudo[82705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:08 devstack sudo[82705]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:08 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:08 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:54:08 devstack sudo[82715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:54:08 devstack sudo[82715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:54:08 devstack sudo[82715]: pam_unix(sudo:session): session closed for user root Jul 18 05:54:08 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:54:08 devstack cinder-volume[76243]: DEBUG cinder.manager [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Notifying Schedulers of capabilities ... {{(pid=76243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:07 devstack cinder-volume[76243]: DEBUG oslo_service.periodic_task [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:55:07 devstack cinder-volume[76243]: DEBUG cinder.volume.drivers.lvm [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Updating volume stats {{(pid=76243) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:55:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:07 devstack sudo[85231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:55:07 devstack sudo[85231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:07 devstack sudo[85231]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:07 devstack sudo[85236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:55:07 devstack sudo[85236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:07 devstack sudo[85236]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:07 devstack sudo[85239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:55:07 devstack sudo[85239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:08 devstack sudo[85239]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:08 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:08 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:55:08 devstack sudo[85242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:55:08 devstack sudo[85242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:55:08 devstack sudo[85242]: pam_unix(sudo:session): session closed for user root Jul 18 05:55:08 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:55:08 devstack cinder-volume[76243]: DEBUG cinder.manager [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Notifying Schedulers of capabilities ... {{(pid=76243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:55:08 devstack cinder-volume[76243]: DEBUG oslo_service.periodic_task [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running periodic task VolumeManager._thread_info {{(pid=76243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:55:08 devstack cinder-volume[76243]: DEBUG cinder.volume.manager [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] thread count: 6 {{(pid=76243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:55:08 devstack cinder-volume[76243]: DEBUG cinder.volume.manager [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] thread info: [<_MainThread(MainThread, started 129532145946752)>, , , , , ] {{(pid=76243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:56:01 devstack cinder-volume[76243]: DEBUG dbcounter [-] [76243] Writing DB stats cinder:SELECT=1 {{(pid=76243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:56:01 devstack cinder-volume[76243]: DEBUG dbcounter [-] [76243] Writing DB stats cinder:UPDATE=1 {{(pid=76243) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:56:07 devstack cinder-volume[76243]: DEBUG oslo_service.periodic_task [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:56:07 devstack cinder-volume[76243]: DEBUG cinder.volume.drivers.lvm [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Updating volume stats {{(pid=76243) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 18 05:56:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:07 devstack sudo[86364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 18 05:56:07 devstack sudo[86364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:07 devstack sudo[86364]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:07 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:56:07 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:07 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:07 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:07 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 18 05:56:07 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:08 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:08 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:08 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:08 devstack sudo[86396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 18 05:56:08 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:08 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:08 devstack cinder-volume[76243]: DEBUG oslo_concurrency.processutils [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76243) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:08 devstack cinder-volume[76243]: DEBUG cinder.manager [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Notifying Schedulers of capabilities ... {{(pid=76243) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:08 devstack cinder-volume[76243]: DEBUG oslo_service.periodic_task [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] Running periodic task VolumeManager._thread_info {{(pid=76243) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:56:08 devstack cinder-volume[76243]: DEBUG cinder.volume.manager [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] thread count: 6 {{(pid=76243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:56:08 devstack cinder-volume[76243]: DEBUG cinder.volume.manager [None req-8aa57c1d-f6cd-4500-b7a6-b768641d6142 None None] thread info: [<_MainThread(MainThread, started 129532145946752)>, , , , , ] {{(pid=76243) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:56:18 devstack cinder-volume[76090]: INFO oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Caught SIGTERM, stopping children Jul 18 05:56:18 devstack cinder-volume[76090]: DEBUG oslo_concurrency.lockutils [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Acquiring lock "singleton_lock" {{(pid=76090) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:56:18 devstack cinder-volume[76090]: DEBUG oslo_concurrency.lockutils [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Acquired lock "singleton_lock" {{(pid=76090) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:56:18 devstack cinder-volume[76090]: DEBUG oslo_concurrency.lockutils [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Releasing lock "singleton_lock" {{(pid=76090) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:56:18 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Stop services. {{(pid=76090) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 18 05:56:18 devstack cinder-volume[76090]: DEBUG oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Killing children. {{(pid=76090) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 18 05:56:18 devstack cinder-volume[76090]: INFO oslo_service.backend._eventlet.service [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Waiting on 1 children to exit Jul 18 05:56:23 devstack cinder-volume[76243]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 18 05:56:24 devstack cinder-volume[86746]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 18 05:56:24 devstack cinder-volume[86746]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 18 05:56:24 devstack cinder-volume[86746]: we strongly recommend against using it for new projects. Jul 18 05:56:24 devstack cinder-volume[86746]: If you are already using Eventlet, we recommend migrating to a different Jul 18 05:56:24 devstack cinder-volume[86746]: framework. For more detail see Jul 18 05:56:24 devstack cinder-volume[86746]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 18 05:56:24 devstack cinder-volume[86746]: import eventlet # noqa Jul 18 05:56:25 devstack cinder-volume[76243]: DEBUG oslo_concurrency.lockutils [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Acquiring lock "singleton_lock" {{(pid=76243) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:56:25 devstack cinder-volume[76243]: DEBUG oslo_concurrency.lockutils [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Acquired lock "singleton_lock" {{(pid=76243) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:56:25 devstack cinder-volume[76243]: DEBUG oslo_concurrency.lockutils [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Releasing lock "singleton_lock" {{(pid=76243) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:56:25 devstack cinder-volume[76243]: WARNING amqp [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 18 05:56:25 devstack cinder-volume[76243]: WARNING amqp [None req-bd0b62a5-a769-4023-b0f9-16c03b14e61e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 18 05:56:26 devstack cinder-volume[86746]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:56:26 devstack cinder-volume[86746]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:56:26 devstack cinder-volume[86746]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:56:26 devstack cinder-volume[86746]: INFO dbcounter [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Registered counter for database cinder Jul 18 05:56:26 devstack cinder-volume[86746]: DEBUG oslo_db.sqlalchemy.engines [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG dbcounter [-] [86746] Writer thread running {{(pid=86746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 18 05:56:27 devstack cinder-volume[86746]: INFO cinder.rpc [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 18 05:56:27 devstack cinder-volume[86746]: INFO cinder.rpc [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_db.sqlalchemy.engines [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:56:27 devstack cinder-volume[86746]: INFO cinder.volume.manager [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Determined volume DB was empty at startup. Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG cinder.volume.manager [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86746) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 18 05:56:27 devstack cinder-volume[86746]: INFO cinder.volume.manager [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 18 05:56:27 devstack cinder-volume[86746]: WARNING stevedore.named [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 18 05:56:27 devstack cinder-volume[86746]: WARNING castellan.key_manager [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:56:27 devstack cinder-volume[86746]: WARNING cinder.keymgr.conf_key_mgr [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:56:27 devstack cinder-volume[86746]: INFO cinder.volume.manager [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_db.sqlalchemy.engines [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:56:27 devstack cinder-volume[86746]: INFO oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Starting 1 workers Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Started child 86971 {{(pid=86746) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Full set of CONF: {{(pid=86746) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] ******************************************************************************** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Configuration options gathered from: {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] ================================================================================ {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] allow_availability_zone_fallback = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] allow_compression_on_image_upload = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] allowed_direct_url_schemes = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] api_rate_limit = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] auth_strategy = keystone {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_availability_zone = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86971]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_host = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_stats_polling_interval = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backup_api_class = cinder.backup.api.API {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backup_name_template = backup-%s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backup_use_same_host = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backup_use_temp_snapshot = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] chap_password = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] chap_username = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cinder_internal_tenant_project_id = 62f275389a274aa39fb01af75803eb7f {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cinder_internal_tenant_user_id = 9bf8be2ddd614c9989fea17926232cb1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cluster = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] compression_format = gzip {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] compute_api_class = cinder.compute.nova.API {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] config_dir = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] config_source = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] control_exchange = openstack {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] debug = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] default_availability_zone = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] default_group_type = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] default_volume_type = QuobyteHD {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] disk_geometry = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] driver_client_cert = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] driver_client_cert_key = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] driver_data_namespace = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] driver_ssl_cert_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] driver_ssl_cert_verify = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] driver_use_ssl = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] enable_new_services = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] enable_unsupported_driver = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] enabled_backends = ['QuobyteHD'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] enforce_multipath_for_image_xfer = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] filter_function = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance_api_insecure = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance_api_servers = ['http://192.168.122.94/image'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance_api_ssl_compression = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance_ca_certificates_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance_catalog_info = image:glance:publicURL {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance_certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance_keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance_num_retries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance_request_timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] goodness_function = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] graceful_shutdown_timeout = 5 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] group_api_class = cinder.group.api.API {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] host = devstack {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] image_compress_on_upload = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] image_conversion_address_space_limit = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] image_conversion_cpu_limit = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] image_conversion_disable = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] image_upload_use_cinder_backend = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] image_upload_use_internal_tenant = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] image_volume_cache_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] image_volume_cache_max_count = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] image_volume_cache_max_size_gb = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] init_host_max_objects_retrieval = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] instance_format = [instance: %(uuid)s] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] iscsi_target_flags = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] iscsi_write_cache = on {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] iser_helper = tgtadm {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] iser_ip_address = 192.168.122.94 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] iser_port = 3260 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] log_color = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] log_config_append = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] log_dir = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] log_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] log_options = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] log_rotate_interval = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] log_rotate_interval_type = days {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] log_rotation_type = none {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] max_age = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] max_logfile_count = 30 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] max_logfile_size_mb = 200 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] max_over_subscription_ratio = 20.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] message_reap_interval = 86400 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] message_ttl = 2592000 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] migration_create_volume_timeout_secs = 300 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] monkey_patch = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] monkey_patch_modules = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] my_ip = 192.168.122.94 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] no_snapshot_gb_quota = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] num_iser_scan_tries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] num_shell_tries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] num_volume_device_scan_tries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] nvmeof_conn_info_version = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] nvmet_ns_id = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86971]: INFO cinder.volume.manager [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Starting volume driver QuobyteDriver (1.2) Jul 18 05:56:27 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.remotefs [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86971) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] nvmet_port_id = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] osapi_max_limit = 1000 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] osapi_volume_ext_list = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] osapi_volume_listen_port = 8776 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] osapi_volume_use_ssl = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] osapi_volume_workers = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] per_volume_size_limit = -1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] periodic_fuzzy_delay = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] periodic_interval = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] public_endpoint = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] publish_errors = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] quota_backup_gigabytes = 1000 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] quota_backups = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] quota_gigabytes = 1000 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] quota_groups = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] quota_snapshots = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] quota_volumes = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] rate_limit_burst = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] rate_limit_except_level = CRITICAL {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] rate_limit_interval = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] reinit_driver_count = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] replication_device = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] report_discard_supported = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] report_interval = 120 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] reservation_clean_interval = 86400 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] reservation_expire = 86400 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] reserved_image_namespaces = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] reserved_percentage = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] rpc_response_timeout = 120 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] run_external_periodic_tasks = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] scst_target_driver = iscsi {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] scst_target_iqn_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] service_down_time = 720 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] shell_completion = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] snapshot_name_template = snapshot-%s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] split_loggers = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] state_path = /opt/stack/data/cinder {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] storage_availability_zone = nova {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] storage_protocol = iSCSI {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] syslog_log_facility = LOG_USER {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] target_helper = lioadm {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] target_ip_address = 192.168.122.94 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] target_port = 3260 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] target_protocol = iscsi {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] target_secondary_ip_addresses = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] trace_flags = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] transport_url = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] until_refresh = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] use_chap_auth = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] use_default_quota_class = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] use_journal = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] use_json = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] use_multipath_for_image_xfer = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] use_stderr = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] use_syslog = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] verify_glance_signatures = enabled {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volume_api_class = cinder.volume.api.API {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volume_backend_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volume_clear = zero {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volume_clear_ionice = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volume_clear_size = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volume_copy_bps_limit = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volume_dd_blocksize = 1M {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volume_name_template = volume-%s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volume_service_inithost_offload = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volume_usage_audit_period = month {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] zoning_mode = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_concurrency.disable_process_locking = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.auth_section = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.auth_type = password {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.auth_version = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.cache = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.include_service_catalog = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.insecure = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.interface = public {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_password = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcache_username = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.region_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.service_type = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.94/identity {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.backend = dogpile.cache.null {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.backend_argument = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.backend_expiration_time = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.config_prefix = cache.oslo {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.debug_cache_backend = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.enable_retry_client = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.enable_socket_keepalive = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.expiration_time = 600 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.hashclient_retry_attempts = 2 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.memcache_dead_retry = 300 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.memcache_pool_maxsize = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.memcache_sasl_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.password = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.proxies = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.redis_db = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.redis_server = localhost:6379 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.retry_attempts = 2 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.retry_delay = 0.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.socket_keepalive_count = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.socket_keepalive_idle = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.socket_keepalive_interval = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.socket_timeout = 1.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.tls_allowed_ciphers = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.tls_cafile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.tls_certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.tls_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.tls_keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cache.username = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] coordination.backend_url = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.asyncio_connection = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.asyncio_slave_connection = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.backend = sqlalchemy {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.connection = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.connection_debug = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.connection_parameters = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.connection_recycle_time = 3600 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.connection_trace = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86971) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 18 05:56:27 devstack cinder-volume[86971]: WARNING cinder.volume.drivers.quobyte [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 18 05:56:27 devstack cinder-volume[86971]: WARNING cinder.volume.drivers.quobyte [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 18 05:56:27 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Running cmd (subprocess): mount.quobyte {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.db_inc_retry_interval = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.db_max_retries = 20 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.db_max_retry_interval = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.db_retry_interval = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.max_overflow = 50 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.max_pool_size = 5 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.max_retries = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.mysql_wsrep_sync_wait = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.pool_timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.retry_interval = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.slave_connection = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.sqlite_synchronous = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.synchronous_reader = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] database.use_db_reconnect = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler.connection_string = messaging:// {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler.enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler.es_doc_type = notification {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler.es_scroll_size = 10000 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler.es_scroll_time = 2m {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler.filter_error_trace = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler.hmac_keys = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler.sentinel_service_name = mymaster {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler.socket_timeout = 0.1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler.trace_requests = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler.trace_sqlalchemy = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:27 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler_jaeger.process_tags = {} {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler_jaeger.service_name_prefix = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] profiler_otlp.service_name_prefix = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_policy.enforce_new_defaults = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_policy.policy_default_rule = default {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_policy.policy_file = policy.yaml {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] privsep_osbrick.group = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] privsep_osbrick.helper_command = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] privsep_osbrick.user = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cinder_sys_admin.group = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cinder_sys_admin.helper_command = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] cinder_sys_admin.user = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] service_user.auth_section = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] service_user.auth_type = password {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] service_user.cafile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] service_user.certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] service_user.collect_timing = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] service_user.insecure = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] service_user.keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] service_user.send_service_user_token = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] service_user.split_loggers = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] service_user.timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance.auth_section = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance.auth_type = password {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance.certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance.collect_timing = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance.insecure = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance.keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance.region_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance.split_loggers = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] glance.timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.backend_availability_zone = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.chap_password = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.chap_username = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.disk_geometry = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.driver_client_cert = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.driver_client_cert_key = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.driver_data_namespace = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.driver_use_ssl = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.extra_capabilities = {} {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.filter_function = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.goodness_function = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.iscsi_target_flags = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.iscsi_write_cache = on {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.iser_helper = tgtadm {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.iser_ip_address = 192.168.122.94 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.iser_port = 3260 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nas_host = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nas_login = admin {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nas_mount_options = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nas_password = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nas_private_key = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nas_share_path = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.num_shell_tries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.quobyte_volume_url = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.replication_device = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.report_discard_supported = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.reserved_percentage = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.target_helper = tgtadm {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.target_ip_address = 192.168.122.94 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.target_port = 3260 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.target_protocol = iscsi {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.trace_flags = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.unique_fqdn_network = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.use_chap_auth = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.volume_backend_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.volume_clear = zero {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.volume_clear_ionice = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.volume_clear_size = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_reports.file_event_handler = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_reports.log_dir = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.backend_availability_zone = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.backend_host = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.chap_password = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.chap_username = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.chiscsi_conf = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.disk_geometry = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.driver_client_cert = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.driver_data_namespace = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.driver_use_ssl = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.extra_capabilities = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.filter_function = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.goodness_function = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.iser_helper = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.iser_ip_address = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.iser_port = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.iser_target_prefix = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nas_host = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack quobyte-client[86983]: Reading configuration file: /etc/quobyte/client.cfg Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nas_login = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nas_mount_options = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nas_password = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nas_private_key = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack quobyte-client[86983]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nas_share_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nas_ssh_port = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.num_shell_tries = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] CMD "mount.quobyte" returned: 1 in 0.134s {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=86971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.nvmet_port_id = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86971]: INFO cinder.volume.drivers.quobyte [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d ... Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 -c /etc/quobyte/client-cinder.cfg {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.replication_device = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.report_discard_supported = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.reserved_percentage = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.scst_target_driver = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.storage_protocol = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.target_helper = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.target_ip_address = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.target_port = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.target_prefix = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.target_protocol = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.trace_flags = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.use_chap_auth = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.volume_clear = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.volume_clear_size = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] QuobyteHD.volumes_dir = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.ssl = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_notifications.driver = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_notifications.retry = -1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] key_manager.fixed_key = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.barbican_api_version = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.barbican_endpoint = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.barbican_endpoint_type = public {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.barbican_region_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.cafile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.collect_timing = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.insecure = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack sudo[86985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 -c /etc/quobyte/client-cinder.cfg Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.number_of_retries = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.retry_delay = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.send_service_user_token = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.split_loggers = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.verify_ssl = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican.verify_ssl_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican_service_user.auth_section = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican_service_user.auth_type = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican_service_user.cafile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican_service_user.certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican_service_user.collect_timing = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican_service_user.insecure = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican_service_user.keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican_service_user.split_loggers = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] barbican_service_user.timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.approle_role_id = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.approle_secret_id = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.auth_method = approle {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.auth_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.kv_mountpoint = secret {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.kv_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.kv_version = 2 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.namespace = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.root_token_id = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.ssl_ca_crt_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.timeout = 60.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.token_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.token_role = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.use_ssl = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:28 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] ******************************************************************************** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 18 05:56:28 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.423s {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:28 devstack cinder-volume[86971]: INFO cinder.volume.drivers.quobyte [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d succeeded Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=86971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.440s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:28 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:56:28 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:28 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.246s {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:28 devstack cinder-volume[86971]: INFO cinder.volume.driver [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Driver hasn't implemented _init_vendor_properties() Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG cinder.volume.driver [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7434043884277, 'free_capacity_gb': 1775.7434043884277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86971) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_db.sqlalchemy.engines [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86971) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG dbcounter [-] [86971] Writer thread running {{(pid=86971) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG cinder.db.api [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Building query based on filter {{(pid=86971) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG cinder.image.image_utils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86971) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 18 05:56:28 devstack cinder-volume[86971]: INFO cinder.keymgr.migration [None req-aef9d431-f6ed-4527-a879-7c7ef1328d2e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=86971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=86971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:28 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:28 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:56:28 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:29 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:29 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.252s {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:29 devstack cinder-volume[86971]: DEBUG cinder.manager [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Notifying Schedulers of capabilities ... {{(pid=86971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:29 devstack cinder-volume[86971]: INFO cinder.volume.manager [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Driver initialization completed successfully. Jul 18 05:56:29 devstack cinder-volume[86971]: INFO cinder.manager [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Initiating service 3 cleanup Jul 18 05:56:29 devstack cinder-volume[86971]: INFO cinder.manager [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Service 3 cleanup completed. Jul 18 05:56:29 devstack cinder-volume[86971]: DEBUG cinder.service [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Creating RPC server for service cinder-volume {{(pid=86971) start /opt/stack/cinder/cinder/service.py:231}} Jul 18 05:56:29 devstack cinder-volume[86971]: DEBUG cinder.service [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86971) start /opt/stack/cinder/cinder/service.py:237}} Jul 18 05:56:29 devstack cinder-volume[86971]: INFO cinder.volume.manager [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 18 05:56:29 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:29 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:29 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=86971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:29 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=86971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:29 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:29 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:29 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:56:29 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:29 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:29 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.261s {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:29 devstack cinder-volume[86971]: INFO cinder.volume.manager [None req-3a5f3d30-2ce2-451d-9f77-ef8f3abc1bdf None None] Driver post RPC initialization completed successfully. Jul 18 05:56:34 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-218a2dd1-0256-438f-bdda-2c51bc2460f4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:34 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-218a2dd1-0256-438f-bdda-2c51bc2460f4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:34 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-218a2dd1-0256-438f-bdda-2c51bc2460f4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=86971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:34 devstack cinder-volume[86971]: DEBUG cinder.volume.drivers.quobyte [None req-218a2dd1-0256-438f-bdda-2c51bc2460f4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=86971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:34 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-218a2dd1-0256-438f-bdda-2c51bc2460f4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86971) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:34 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-218a2dd1-0256-438f-bdda-2c51bc2460f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:34 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:56:34 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:34 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:34 devstack cinder-volume[86971]: DEBUG oslo_concurrency.processutils [None req-218a2dd1-0256-438f-bdda-2c51bc2460f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.253s {{(pid=86971) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:34 devstack cinder-volume[86971]: DEBUG cinder.manager [None req-218a2dd1-0256-438f-bdda-2c51bc2460f4 None None] Notifying Schedulers of capabilities ... {{(pid=86971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:35 devstack cinder-volume[86746]: INFO oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Caught SIGTERM, stopping children Jul 18 05:56:35 devstack cinder-volume[86746]: DEBUG oslo_concurrency.lockutils [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Acquiring lock "singleton_lock" {{(pid=86746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:56:35 devstack cinder-volume[86746]: DEBUG oslo_concurrency.lockutils [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Acquired lock "singleton_lock" {{(pid=86746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:56:35 devstack cinder-volume[86746]: DEBUG oslo_concurrency.lockutils [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Releasing lock "singleton_lock" {{(pid=86746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:56:35 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Stop services. {{(pid=86746) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 18 05:56:35 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Killing children. {{(pid=86746) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 18 05:56:35 devstack cinder-volume[86746]: INFO oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Waiting on 1 children to exit Jul 18 05:56:37 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Acquiring lock "singleton_lock" {{(pid=86971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:56:37 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Acquired lock "singleton_lock" {{(pid=86971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:56:37 devstack cinder-volume[86971]: DEBUG oslo_concurrency.lockutils [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Releasing lock "singleton_lock" {{(pid=86971) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:56:37 devstack cinder-volume[86971]: WARNING amqp [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 18 05:56:37 devstack cinder-volume[86971]: WARNING amqp [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 18 05:56:37 devstack cinder-volume[86746]: INFO oslo_service.backend._eventlet.service [None req-0f905763-9351-4dc5-8d23-8a8f2c6363e9 None None] Child 86971 exited with status 0 Jul 18 05:56:38 devstack cinder-volume[87441]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 18 05:56:38 devstack cinder-volume[87441]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 18 05:56:38 devstack cinder-volume[87441]: we strongly recommend against using it for new projects. Jul 18 05:56:38 devstack cinder-volume[87441]: If you are already using Eventlet, we recommend migrating to a different Jul 18 05:56:38 devstack cinder-volume[87441]: framework. For more detail see Jul 18 05:56:38 devstack cinder-volume[87441]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 18 05:56:38 devstack cinder-volume[87441]: import eventlet # noqa Jul 18 05:56:40 devstack cinder-volume[87441]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 18 05:56:40 devstack cinder-volume[87441]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 18 05:56:40 devstack cinder-volume[87441]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 18 05:56:42 devstack cinder-volume[87441]: INFO dbcounter [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] Registered counter for database cinder Jul 18 05:56:42 devstack cinder-volume[87441]: DEBUG oslo_db.sqlalchemy.engines [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:56:42 devstack cinder-volume[87441]: DEBUG dbcounter [-] [87441] Writer thread running {{(pid=87441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 18 05:56:42 devstack cinder-volume[87441]: INFO cinder.rpc [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 18 05:56:42 devstack cinder-volume[87441]: INFO cinder.rpc [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_db.sqlalchemy.engines [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:56:43 devstack cinder-volume[87441]: INFO cinder.volume.manager [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] Determined volume DB was empty at startup. Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG cinder.volume.manager [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87441) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 18 05:56:43 devstack cinder-volume[87441]: WARNING stevedore.named [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 18 05:56:43 devstack cinder-volume[87441]: WARNING castellan.key_manager [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:56:43 devstack cinder-volume[87441]: WARNING cinder.keymgr.conf_key_mgr [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 18 05:56:43 devstack cinder-volume[87441]: INFO cinder.volume.manager [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_db.sqlalchemy.engines [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:56:43 devstack cinder-volume[87441]: INFO oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] Starting 1 workers Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] Started child 87750 {{(pid=87441) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] Full set of CONF: {{(pid=87441) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] ******************************************************************************** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] Configuration options gathered from: {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] ================================================================================ {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] allow_availability_zone_fallback = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87750]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] allow_compression_on_image_upload = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] allowed_direct_url_schemes = [] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] api_rate_limit = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] auth_strategy = keystone {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_availability_zone = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_host = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_name = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_stats_polling_interval = 60 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backup_api_class = cinder.backup.api.API {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backup_name_template = backup-%s {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backup_use_same_host = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backup_use_temp_snapshot = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] chap_password = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] chap_username = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cinder_internal_tenant_project_id = 62f275389a274aa39fb01af75803eb7f {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cinder_internal_tenant_user_id = 9bf8be2ddd614c9989fea17926232cb1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cluster = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] compression_format = gzip {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] compute_api_class = cinder.compute.nova.API {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] config_dir = [] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] config_source = [] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] control_exchange = openstack {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] debug = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] default_availability_zone = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] default_group_type = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] default_volume_type = QuobyteHD {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] disk_geometry = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] driver_client_cert = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] driver_client_cert_key = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] driver_data_namespace = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] driver_ssl_cert_path = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] driver_ssl_cert_verify = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] driver_use_ssl = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] enable_new_services = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] enable_unsupported_driver = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] enabled_backends = ['QuobyteHD'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] enforce_multipath_for_image_xfer = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] filter_function = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance_api_insecure = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance_api_servers = ['http://192.168.122.94/image'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance_api_ssl_compression = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance_ca_certificates_file = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance_catalog_info = image:glance:publicURL {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance_certfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance_keyfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance_num_retries = 3 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance_request_timeout = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] goodness_function = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] graceful_shutdown_timeout = 5 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] group_api_class = cinder.group.api.API {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] host = devstack {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] image_compress_on_upload = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] image_conversion_address_space_limit = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] image_conversion_cpu_limit = 60 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] image_conversion_disable = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] image_upload_use_cinder_backend = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] image_upload_use_internal_tenant = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] image_volume_cache_enabled = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] image_volume_cache_max_count = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] image_volume_cache_max_size_gb = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] init_host_max_objects_retrieval = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] instance_format = [instance: %(uuid)s] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] iscsi_target_flags = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] iscsi_write_cache = on {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] iser_helper = tgtadm {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] iser_ip_address = 192.168.122.94 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] iser_port = 3260 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] log_color = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] log_config_append = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] log_dir = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] log_file = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] log_options = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] log_rotate_interval = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] log_rotate_interval_type = days {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] log_rotation_type = none {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] max_age = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] max_logfile_count = 30 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] max_logfile_size_mb = 200 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] max_over_subscription_ratio = 20.0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] message_reap_interval = 86400 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] message_ttl = 2592000 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] migration_create_volume_timeout_secs = 300 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] monkey_patch = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Starting volume driver QuobyteDriver (1.2) Jul 18 05:56:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87750) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] monkey_patch_modules = [] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] my_ip = 192.168.122.94 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] no_snapshot_gb_quota = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] num_iser_scan_tries = 3 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] num_shell_tries = 3 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] num_volume_device_scan_tries = 3 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] nvmeof_conn_info_version = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] nvmet_ns_id = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] nvmet_port_id = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] osapi_max_limit = 1000 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] osapi_volume_ext_list = [] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] osapi_volume_listen_port = 8776 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] osapi_volume_use_ssl = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] osapi_volume_workers = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] per_volume_size_limit = -1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] periodic_fuzzy_delay = 60 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] periodic_interval = 60 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] public_endpoint = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] publish_errors = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] quota_backup_gigabytes = 1000 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] quota_backups = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] quota_gigabytes = 1000 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] quota_groups = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] quota_snapshots = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] quota_volumes = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] rate_limit_burst = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] rate_limit_except_level = CRITICAL {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] rate_limit_interval = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] reinit_driver_count = 3 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] replication_device = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] report_discard_supported = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] report_interval = 120 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] reservation_clean_interval = 86400 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] reservation_expire = 86400 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] reserved_image_namespaces = [] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] reserved_percentage = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] rpc_response_timeout = 120 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] run_external_periodic_tasks = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] scst_target_driver = iscsi {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] scst_target_iqn_name = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] service_down_time = 720 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] shell_completion = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] snapshot_name_template = snapshot-%s {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] split_loggers = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] state_path = /opt/stack/data/cinder {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] storage_availability_zone = nova {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] storage_protocol = iSCSI {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] syslog_log_facility = LOG_USER {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] target_helper = lioadm {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] target_ip_address = 192.168.122.94 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] target_port = 3260 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] target_protocol = iscsi {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] target_secondary_ip_addresses = [] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] trace_flags = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] transport_url = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] until_refresh = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] use_chap_auth = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] use_default_quota_class = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] use_journal = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] use_json = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] use_multipath_for_image_xfer = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] use_stderr = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] use_syslog = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] verify_glance_signatures = enabled {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volume_api_class = cinder.volume.api.API {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volume_backend_name = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volume_clear = zero {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volume_clear_ionice = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volume_clear_size = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volume_copy_bps_limit = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volume_dd_blocksize = 1M {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volume_name_template = volume-%s {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volume_service_inithost_offload = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volume_usage_audit_period = month {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] zoning_mode = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_concurrency.disable_process_locking = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.auth_section = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.auth_type = password {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.auth_version = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.cache = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.certfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.include_service_catalog = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.insecure = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.interface = public {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.keyfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_password = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87750) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.quobyte [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.quobyte [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Running cmd (subprocess): mount.quobyte {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcache_username = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.region_name = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.service_type = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.94/identity {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.backend = dogpile.cache.null {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.backend_argument = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.backend_expiration_time = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.config_prefix = cache.oslo {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.debug_cache_backend = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.enable_retry_client = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.enable_socket_keepalive = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.enabled = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.expiration_time = 600 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.hashclient_retry_attempts = 2 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.memcache_dead_retry = 300 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.memcache_pool_maxsize = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.memcache_sasl_enabled = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.password = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.proxies = [] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.redis_db = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.redis_server = localhost:6379 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.retry_attempts = 2 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.retry_delay = 0.0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.socket_keepalive_count = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.socket_keepalive_idle = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.socket_keepalive_interval = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.socket_timeout = 1.0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.tls_allowed_ciphers = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.tls_cafile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.tls_certfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.tls_enabled = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.tls_keyfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cache.username = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] coordination.backend_url = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.asyncio_connection = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.asyncio_slave_connection = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.backend = sqlalchemy {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.connection = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.connection_debug = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.connection_parameters = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.connection_recycle_time = 3600 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.connection_trace = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.db_inc_retry_interval = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.db_max_retries = 20 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.db_max_retry_interval = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.db_retry_interval = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.max_overflow = 50 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.max_pool_size = 5 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.max_retries = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.mysql_wsrep_sync_wait = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.pool_timeout = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.retry_interval = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.slave_connection = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.sqlite_synchronous = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.synchronous_reader = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] database.use_db_reconnect = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler.connection_string = messaging:// {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler.enabled = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler.es_doc_type = notification {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler.es_scroll_size = 10000 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler.es_scroll_time = 2m {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler.filter_error_trace = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler.hmac_keys = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler.sentinel_service_name = mymaster {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler.socket_timeout = 0.1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler.trace_requests = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler.trace_sqlalchemy = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler_jaeger.process_tags = {} {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler_jaeger.service_name_prefix = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] profiler_otlp.service_name_prefix = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_policy.enforce_new_defaults = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_policy.policy_default_rule = default {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_policy.policy_file = policy.yaml {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] privsep_osbrick.group = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] privsep_osbrick.helper_command = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] privsep_osbrick.user = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cinder_sys_admin.group = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cinder_sys_admin.helper_command = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] cinder_sys_admin.user = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] service_user.auth_section = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] service_user.auth_type = password {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] service_user.cafile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] service_user.certfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] service_user.collect_timing = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] service_user.insecure = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] service_user.keyfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] service_user.send_service_user_token = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] service_user.split_loggers = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] service_user.timeout = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance.auth_section = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance.auth_type = password {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance.certfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance.collect_timing = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance.insecure = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance.keyfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance.region_name = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance.split_loggers = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] glance.timeout = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.backend_availability_zone = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.chap_password = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.chap_username = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.disk_geometry = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.driver_client_cert = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.driver_client_cert_key = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.driver_data_namespace = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.driver_use_ssl = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.extra_capabilities = {} {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.filter_function = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.goodness_function = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.iscsi_target_flags = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.iscsi_write_cache = on {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.iser_helper = tgtadm {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.iser_ip_address = 192.168.122.94 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.iser_port = 3260 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nas_host = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nas_login = admin {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nas_mount_options = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nas_password = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nas_private_key = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nas_share_path = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.num_shell_tries = 3 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.quobyte_volume_url = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.replication_device = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.report_discard_supported = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.reserved_percentage = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.target_helper = tgtadm {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.target_ip_address = 192.168.122.94 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.target_port = 3260 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.target_protocol = iscsi {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.trace_flags = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.unique_fqdn_network = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.use_chap_auth = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.volume_backend_name = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.volume_clear = zero {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.volume_clear_ionice = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.volume_clear_size = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_reports.file_event_handler = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_reports.log_dir = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.backend_availability_zone = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.backend_host = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.chap_password = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.chap_username = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.chiscsi_conf = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.disk_geometry = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.driver_client_cert = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.driver_data_namespace = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.driver_use_ssl = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.extra_capabilities = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.filter_function = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.goodness_function = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.iser_helper = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.iser_ip_address = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.iser_port = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.iser_target_prefix = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nas_host = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nas_login = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nas_mount_options = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nas_password = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nas_private_key = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nas_share_path = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nas_ssh_port = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.num_shell_tries = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.nvmet_port_id = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.replication_device = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.report_discard_supported = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.reserved_percentage = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.scst_target_driver = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.storage_protocol = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.target_helper = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.target_ip_address = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.target_port = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.target_prefix = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.target_protocol = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.trace_flags = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.use_chap_auth = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.volume_clear = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.volume_clear_size = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] QuobyteHD.volumes_dir = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.ssl = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_notifications.driver = [] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_notifications.retry = -1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] key_manager.fixed_key = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.barbican_api_version = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.barbican_endpoint = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.barbican_endpoint_type = public {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.barbican_region_name = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.cafile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.certfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.collect_timing = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.insecure = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.keyfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.number_of_retries = 60 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.retry_delay = 1 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.send_service_user_token = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.split_loggers = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.timeout = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.verify_ssl = True {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican.verify_ssl_path = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican_service_user.auth_section = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican_service_user.auth_type = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican_service_user.cafile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican_service_user.certfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican_service_user.collect_timing = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican_service_user.insecure = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican_service_user.keyfile = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican_service_user.split_loggers = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] barbican_service_user.timeout = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.approle_role_id = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.approle_secret_id = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.auth_method = approle {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.auth_path = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.kv_mountpoint = secret {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] CMD "mount.quobyte" returned: 1 in 0.135s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.kv_path = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.kv_version = 2 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.namespace = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.root_token_id = **** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.ssl_ca_crt_file = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.timeout = 60.0 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.token_file = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.token_role = None {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.use_ssl = False {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 18 05:56:43 devstack cinder-volume[87441]: DEBUG oslo_service.backend._eventlet.service [None req-8e85f8e8-83c7-4a78-91ee-b7396a1cb8d4 None None] ******************************************************************************** {{(pid=87441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 18 05:56:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:44 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.357s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:44 devstack cinder-volume[87750]: INFO cinder.volume.driver [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Driver hasn't implemented _init_vendor_properties() Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG cinder.volume.driver [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7434043884277, 'free_capacity_gb': 1775.7434043884277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87750) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG oslo_db.sqlalchemy.engines [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87750) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writer thread running {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG cinder.db.api [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Building query based on filter {{(pid=87750) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87750) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:44 devstack cinder-volume[87750]: INFO cinder.keymgr.migration [None req-ee001c4a-e38c-4eac-8c00-3f3d09863307 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 18 05:56:44 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:56:44 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:44 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.262s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:56:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Driver initialization completed successfully. Jul 18 05:56:44 devstack cinder-volume[87750]: INFO cinder.manager [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Initiating service 3 cleanup Jul 18 05:56:44 devstack cinder-volume[87750]: INFO cinder.manager [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Service 3 cleanup completed. Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG cinder.service [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Creating RPC server for service cinder-volume {{(pid=87750) start /opt/stack/cinder/cinder/service.py:231}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG cinder.service [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87750) start /opt/stack/cinder/cinder/service.py:237}} Jul 18 05:56:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:56:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:56:44 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:56:44 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:56:45 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Jul 18 05:56:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:56:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fe11a18c-2007-41a3-b406-d41a57cc5146 None None] Driver post RPC initialization completed successfully. Jul 18 05:56:53 devstack cinder-volume[87441]: DEBUG dbcounter [-] [87441] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:56:54 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:56:55 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:57:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:57:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 6 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:57:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Flow 'volume_create_manager' (ad5c4021-bbb2-412e-83be-e6befad3cf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (debf7511-622b-4ffa-ace9-4e346f93a1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (debf7511-622b-4ffa-ace9-4e346f93a1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-74545055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f333c5e-215f-40cd-904a-0dad6c742061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d640069a008f48fe9897359734a55da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:46Z,use_quota=True,user_id='55dc15f3c13d475fb7d1ef7bef6b63d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c79d4e9-d012-435f-abec-3d6945308aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c79d4e9-d012-435f-abec-3d6945308aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef2bff1-a011-4e1e-b96c-0bcdc521b5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef2bff1-a011-4e1e-b96c-0bcdc521b5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f333c5e-215f-40cd-904a-0dad6c742061', 'volume_name': 'volume-5f333c5e-215f-40cd-904a-0dad6c742061', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4eb0f49-1494-415d-9384-65c2c0998e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4eb0f49-1494-415d-9384-65c2c0998e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d329c77f-19f1-4feb-a644-3488db2f2af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:45 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Volume 5f333c5e-215f-40cd-904a-0dad6c742061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f333c5e-215f-40cd-904a-0dad6c742061', 'volume_size': 1} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-74545055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f333c5e-215f-40cd-904a-0dad6c742061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d640069a008f48fe9897359734a55da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:46Z,use_quota=True,user_id='55dc15f3c13d475fb7d1ef7bef6b63d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Creating volume 5f333c5e-215f-40cd-904a-0dad6c742061 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:45 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 05:57:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5f333c5e-215f-40cd-904a-0dad6c742061 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:45 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5f333c5e-215f-40cd-904a-0dad6c742061 1073741824 Jul 18 05:57:45 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:46 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5f333c5e-215f-40cd-904a-0dad6c742061 1073741824" returned: 0 in 0.706s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5f333c5e-215f-40cd-904a-0dad6c742061 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:46 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5f333c5e-215f-40cd-904a-0dad6c742061 Jul 18 05:57:46 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:46 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5f333c5e-215f-40cd-904a-0dad6c742061" returned: 0 in 0.332s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d329c77f-19f1-4feb-a644-3488db2f2af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f333c5e-215f-40cd-904a-0dad6c742061', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaea6a4-a028-4a4a-8941-c1c737b4402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:46 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Volume volume-5f333c5e-215f-40cd-904a-0dad6c742061 (5f333c5e-215f-40cd-904a-0dad6c742061): created successfully Jul 18 05:57:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caaea6a4-a028-4a4a-8941-c1c737b4402a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Flow 'volume_create_manager' (ad5c4021-bbb2-412e-83be-e6befad3cf1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-01da2e86-cabe-4733-9c39-d36ff25152ff tempest-TaggedAttachmentsTest-1425330271 None] Created volume successfully. Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Flow 'volume_create_manager' (a01f6e67-08b3-417f-bb83-84b9be7d75d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61361366-c24b-477a-aa15-7cc7509be913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61361366-c24b-477a-aa15-7cc7509be913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-662618853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506c11676c344f46a92c6e8346d1df8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:56Z,use_quota=True,user_id='de843d7bb373447f942119bddf200823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058c4c8d-bb55-47b3-8e12-82a10d5ac3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058c4c8d-bb55-47b3-8e12-82a10d5ac3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e83e7ae-406b-4893-9eca-cb79f2f521d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e83e7ae-406b-4893-9eca-cb79f2f521d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372', 'volume_name': 'volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91010a3-40bd-4c74-9c79-ce0225ce2c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91010a3-40bd-4c74-9c79-ce0225ce2c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07abac8-a087-4456-913a-1673572e3fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:56 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Volume 8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372', 'volume_size': 1} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-662618853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='506c11676c344f46a92c6e8346d1df8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:57:56Z,use_quota=True,user_id='de843d7bb373447f942119bddf200823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Creating volume 8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:57:56 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 05:57:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:56 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372 1073741824 Jul 18 05:57:56 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:57 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372 1073741824" returned: 0 in 0.974s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:57:57 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372 Jul 18 05:57:57 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:57:57 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Jul 18 05:57:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372" returned: 0 in 0.387s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:57:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:57:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:57:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07abac8-a087-4456-913a-1673572e3fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d778d4eb-a6cb-4ab1-b925-9ec18933a411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:57:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Volume volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372 (8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372): created successfully Jul 18 05:57:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d778d4eb-a6cb-4ab1-b925-9ec18933a411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:57:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Flow 'volume_create_manager' (a01f6e67-08b3-417f-bb83-84b9be7d75d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:57:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8f526052-f009-4e0a-8b06-29c11e08c9b1 tempest-DeleteServersTestJSON-133440896 None] Created volume successfully. Jul 18 05:58:04 devstack cinder-volume[87750]: WARNING py.warnings [req-26b0b2fd-4e78-41d1-b03c-890d45326e30 req-85fde994-51f3-4bbd-9e30-d6c1d53bcc61 tempest-DeleteServersTestJSON-133440896 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 18 05:58:04 devstack cinder-volume[87750]: .first() Jul 18 05:58:04 devstack cinder-volume[87750]: Jul 18 05:58:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-26b0b2fd-4e78-41d1-b03c-890d45326e30 req-85fde994-51f3-4bbd-9e30-d6c1d53bcc61 tempest-DeleteServersTestJSON-133440896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-26b0b2fd-4e78-41d1-b03c-890d45326e30 req-85fde994-51f3-4bbd-9e30-d6c1d53bcc61 tempest-DeleteServersTestJSON-133440896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-26b0b2fd-4e78-41d1-b03c-890d45326e30 req-85fde994-51f3-4bbd-9e30-d6c1d53bcc61 tempest-DeleteServersTestJSON-133440896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-26b0b2fd-4e78-41d1-b03c-890d45326e30 req-85fde994-51f3-4bbd-9e30-d6c1d53bcc61 tempest-DeleteServersTestJSON-133440896 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03e242b6-7db8-4c95-bf3c-c32e8b740875', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:58:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-26b0b2fd-4e78-41d1-b03c-890d45326e30 req-85fde994-51f3-4bbd-9e30-d6c1d53bcc61 tempest-DeleteServersTestJSON-133440896 None] attachment_update completed successfully. Jul 18 05:58:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-ed408d05-6ece-426c-bc47-0fb7adc7bcbb req-491bb4c4-2b53-421f-88cf-e48f2179e6dc tempest-DeleteServersTestJSON-133440896 None] Terminate volume connection completed successfully. Jul 18 05:58:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-ed408d05-6ece-426c-bc47-0fb7adc7bcbb req-491bb4c4-2b53-421f-88cf-e48f2179e6dc tempest-DeleteServersTestJSON-133440896 None] Deleting attachment 03e242b6-7db8-4c95-bf3c-c32e8b740875. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:58:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Acquiring lock "cinder-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Lock "cinder-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Acquiring lock "cinder-quobyte-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:58:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Lock "cinder-quobyte-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372" acquired by "delete_volume" :: waited 0.043s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:58:12 devstack cinder-volume[87750]: INFO oslo.privsep.daemon [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy4_vrdk9/privsep.sock'] Jul 18 05:58:12 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy4_vrdk9/privsep.sock Jul 18 05:58:12 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:13 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 18 05:58:13 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 18 05:58:13 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 18 05:58:13 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: Jul 18 05:58:13 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 18 05:58:13 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 18 05:58:13 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 18 05:58:13 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: Jul 18 05:58:13 devstack cinder-volume[87750]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 18 05:58:14 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:14 devstack cinder-volume[87750]: INFO oslo.privsep.daemon [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Spawned new privsep daemon via rootwrap Jul 18 05:58:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Accepted privsep connection to /tmp/tmpy4_vrdk9/privsep.sock {{(pid=87750) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 18 05:58:14 devstack cinder-volume[87750]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 18 05:58:14 devstack cinder-volume[87750]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 18 05:58:14 devstack cinder-volume[87750]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 18 05:58:14 devstack cinder-volume[87750]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89203 Jul 18 05:58:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6843d7da-886c-48b5-8b66-9a44f361000b]: (2,) {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19bde47-d5b9-475e-8489-49905098f63b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:58:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:14 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372 Jul 18 05:58:14 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:14 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372" returned: 0 in 0.672s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:14 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372 Jul 18 05:58:14 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:15 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372" returned: 0 in 0.424s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Lock "cinder-quobyte-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372" released by "delete_volume" :: held 2.784s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:15 devstack cinder-volume[87750]: WARNING cinder.quota [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:58:15 devstack cinder-volume[87750]: WARNING cinder.quota [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 18 05:58:15 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Created reservations ['ed010738-374f-4972-8941-09e1c9d20454', '7931dbf3-9f33-4cd0-b419-659225ddadfd', '42161e34-6784-4511-9826-b2f7ef1c7bf3', 'f4bd7e84-4707-46a3-b79a-cabe84426c9f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:58:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:15 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:58:15 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:16 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.579s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:16 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Deleted volume successfully. Jul 18 05:58:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a70debe1-ac45-4722-ae67-38bd8a32bb92 tempest-DeleteServersTestJSON-133440896 None] Lock "cinder-8e7ece5b-0cd1-450b-a80e-2c0fbcb7a372-delete_volume" released by "delete_volume" :: held 3.841s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Flow 'volume_create_manager' (426fb692-10ca-4b7c-9c62-433d409974a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e726d629-d34d-46c3-adfb-a80af99e92b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e726d629-d34d-46c3-adfb-a80af99e92b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2113049715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25dd01e5-eb31-4081-8d37-031ed92acc00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690b280615344ed9956cafc9ee6950e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:20Z,use_quota=True,user_id='c4e69f0594894aa7837fcfc396d48ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996912b4-95c8-4961-aec9-076633d3005e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996912b4-95c8-4961-aec9-076633d3005e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50791c8f-20db-4a7c-8d15-3007c287e4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50791c8f-20db-4a7c-8d15-3007c287e4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25dd01e5-eb31-4081-8d37-031ed92acc00', 'volume_name': 'volume-25dd01e5-eb31-4081-8d37-031ed92acc00', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f801d6d2-c5a5-4cec-93f4-fd2f30b9ca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f801d6d2-c5a5-4cec-93f4-fd2f30b9ca5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cafe164-a07a-4552-b242-7fd26b89be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Volume 25dd01e5-eb31-4081-8d37-031ed92acc00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25dd01e5-eb31-4081-8d37-031ed92acc00', 'volume_size': 1} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2113049715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25dd01e5-eb31-4081-8d37-031ed92acc00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='690b280615344ed9956cafc9ee6950e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:58:20Z,use_quota=True,user_id='c4e69f0594894aa7837fcfc396d48ff2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Creating volume 25dd01e5-eb31-4081-8d37-031ed92acc00 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:58:20 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 05:58:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-25dd01e5-eb31-4081-8d37-031ed92acc00 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:20 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-25dd01e5-eb31-4081-8d37-031ed92acc00 1073741824 Jul 18 05:58:20 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:21 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-25dd01e5-eb31-4081-8d37-031ed92acc00 1073741824" returned: 0 in 0.704s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-25dd01e5-eb31-4081-8d37-031ed92acc00 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:21 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-25dd01e5-eb31-4081-8d37-031ed92acc00 Jul 18 05:58:21 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:21 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-25dd01e5-eb31-4081-8d37-031ed92acc00" returned: 0 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:58:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cafe164-a07a-4552-b242-7fd26b89be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25dd01e5-eb31-4081-8d37-031ed92acc00', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92277599-0b35-40ee-b47d-5f8fba70c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:58:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Volume volume-25dd01e5-eb31-4081-8d37-031ed92acc00 (25dd01e5-eb31-4081-8d37-031ed92acc00): created successfully Jul 18 05:58:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92277599-0b35-40ee-b47d-5f8fba70c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:58:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Flow 'volume_create_manager' (426fb692-10ca-4b7c-9c62-433d409974a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:58:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-97e7780c-7684-4b48-b738-0cf4f79f1d06 tempest-ServerActionsTestOtherA-1048510294 None] Created volume successfully. Jul 18 05:58:31 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=18,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:58:31 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=19,cinder:UPDATE=18,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:58:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:58:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:58:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:58:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:58:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:58:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:58:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:58:35 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:58:35 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:58:35 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Jul 18 05:58:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:58:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:58:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:58:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 8 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 05:58:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 05:58:55 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:58:55 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:59:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-6e76915e-42ee-4c01-acba-b3fb264ff8e1 req-58a4b39c-0730-41ad-864e-e16dc648d5d0 tempest-TaggedAttachmentsTest-1425330271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-6e76915e-42ee-4c01-acba-b3fb264ff8e1 req-58a4b39c-0730-41ad-864e-e16dc648d5d0 tempest-TaggedAttachmentsTest-1425330271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-6e76915e-42ee-4c01-acba-b3fb264ff8e1 req-58a4b39c-0730-41ad-864e-e16dc648d5d0 tempest-TaggedAttachmentsTest-1425330271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-6e76915e-42ee-4c01-acba-b3fb264ff8e1 req-58a4b39c-0730-41ad-864e-e16dc648d5d0 tempest-TaggedAttachmentsTest-1425330271 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-5f333c5e-215f-40cd-904a-0dad6c742061', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbe523c7-1595-465f-87a8-27407d2fbbd3', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:59:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-6e76915e-42ee-4c01-acba-b3fb264ff8e1 req-58a4b39c-0730-41ad-864e-e16dc648d5d0 tempest-TaggedAttachmentsTest-1425330271 None] attachment_update completed successfully. Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Flow 'volume_create_manager' (a6210fbe-4e12-4b39-b1e5-6ea1ec26efea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14c1655-8d61-4786-b238-e86b504e561d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14c1655-8d61-4786-b238-e86b504e561d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-290975678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0d0079-c8e0-4f01-93f2-e4cd06f8463e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a22d78581f43e3a1430d5fe6f42dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:59:04Z,use_quota=True,user_id='77e0f9c0f96048d181bf8bd8d2410129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b07a6dc-b0e1-4765-a717-682189e86929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b07a6dc-b0e1-4765-a717-682189e86929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce5f50f-1270-407f-a153-71e1fbf7fe88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce5f50f-1270-407f-a153-71e1fbf7fe88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0d0079-c8e0-4f01-93f2-e4cd06f8463e', 'volume_name': 'volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b44b28b-03d4-4dc6-b401-5ec22f8664d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b44b28b-03d4-4dc6-b401-5ec22f8664d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7450950-efd9-4399-bd7c-77eb0ff2989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Volume ee0d0079-c8e0-4f01-93f2-e4cd06f8463e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e', 'volume_size': 1} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-290975678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0d0079-c8e0-4f01-93f2-e4cd06f8463e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a22d78581f43e3a1430d5fe6f42dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:59:04Z,use_quota=True,user_id='77e0f9c0f96048d181bf8bd8d2410129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Creating volume ee0d0079-c8e0-4f01-93f2-e4cd06f8463e {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:59:03 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 05:59:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:03 devstack sudo[90120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e 1073741824 Jul 18 05:59:03 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:04 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e 1073741824" returned: 0 in 0.914s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:04 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e Jul 18 05:59:04 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:05 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e" returned: 0 in 0.671s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:59:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7450950-efd9-4399-bd7c-77eb0ff2989b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15bd535-7e53-45a3-a52b-481bf55c3fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:05 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Volume volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e (ee0d0079-c8e0-4f01-93f2-e4cd06f8463e): created successfully Jul 18 05:59:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15bd535-7e53-45a3-a52b-481bf55c3fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Flow 'volume_create_manager' (a6210fbe-4e12-4b39-b1e5-6ea1ec26efea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:59:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-bbc3884e-495f-4e23-b7dc-b96e6a0174be tempest-VolumesAdminNegativeTest-1101524326 None] Created volume successfully. Jul 18 05:59:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-08f76b21-e390-49f6-9fcd-ce0c87fb1fc1 req-2c07910c-8da4-43d6-9f8b-cec94bb3207c tempest-TaggedAttachmentsTest-1425330271 None] Terminate volume connection completed successfully. Jul 18 05:59:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-08f76b21-e390-49f6-9fcd-ce0c87fb1fc1 req-2c07910c-8da4-43d6-9f8b-cec94bb3207c tempest-TaggedAttachmentsTest-1425330271 None] Deleting attachment bbe523c7-1595-465f-87a8-27407d2fbbd3. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:59:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Acquiring lock "cinder-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:59:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Lock "cinder-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:59:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Acquiring lock "cinder-quobyte-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:59:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Lock "cinder-quobyte-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e" acquired by "delete_volume" :: waited 0.091s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:59:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00657ec-13cb-42af-b287-7c36b25c2f5f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:59:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:08 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e Jul 18 05:59:08 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:08 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e" returned: 0 in 1.455s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:09 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e Jul 18 05:59:09 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:09 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Lock "cinder-quobyte-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e" released by "delete_volume" :: held 1.879s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:59:09 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Created reservations ['680db7e3-0fb8-4d7e-88fe-cb13a5dc082f', '54a33a3d-3abf-46a4-9c21-e05005cd96db', '3c3aae3b-a792-4988-82f9-f3cc62ec1a2a', '9300fc58-3439-4eaa-886a-83b75295e71b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:59:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:59:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:59:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:09 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:59:09 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:10 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.440s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:10 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:59:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Deleted volume successfully. Jul 18 05:59:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c32e9bb6-a67a-49a5-9108-c276eae47890 tempest-VolumesAdminNegativeTest-1101524326 None] Lock "cinder-ee0d0079-c8e0-4f01-93f2-e4cd06f8463e-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:59:19 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=10,cinder:UPDATE=17,cinder:INSERT=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:59:20 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=19,cinder:UPDATE=8,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:59:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-6838a297-e87c-4c49-a0dd-2217f2ff63c3 req-a225e289-9840-4eff-8186-97c7d44fd2ac tempest-ServerActionsTestOtherA-1048510294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-6838a297-e87c-4c49-a0dd-2217f2ff63c3 req-a225e289-9840-4eff-8186-97c7d44fd2ac tempest-ServerActionsTestOtherA-1048510294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-6838a297-e87c-4c49-a0dd-2217f2ff63c3 req-a225e289-9840-4eff-8186-97c7d44fd2ac tempest-ServerActionsTestOtherA-1048510294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-6838a297-e87c-4c49-a0dd-2217f2ff63c3 req-a225e289-9840-4eff-8186-97c7d44fd2ac tempest-ServerActionsTestOtherA-1048510294 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-25dd01e5-eb31-4081-8d37-031ed92acc00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aaea2824-acdf-4202-b9fe-0fcfd88f08ca', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:59:20 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-6838a297-e87c-4c49-a0dd-2217f2ff63c3 req-a225e289-9840-4eff-8186-97c7d44fd2ac tempest-ServerActionsTestOtherA-1048510294 None] attachment_update completed successfully. Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Flow 'volume_create_manager' (3cc376b3-50cc-4281-a780-2c9ad8c3ef02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0bf6aa-d2f0-4361-a067-208885c69b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0bf6aa-d2f0-4361-a067-208885c69b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1076811298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98c5657-cdea-4283-9b13-d1971e8c46a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb4223ff5cc0476393141fd31db7e223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:59:23Z,use_quota=True,user_id='0449998c67ba4eeea2b4ada47fd792ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93b2aa4-e015-4290-84d1-20ec736df1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93b2aa4-e015-4290-84d1-20ec736df1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b99e7e1-85fd-4d91-99c4-819464302769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b99e7e1-85fd-4d91-99c4-819464302769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98c5657-cdea-4283-9b13-d1971e8c46a5', 'volume_name': 'volume-e98c5657-cdea-4283-9b13-d1971e8c46a5', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9b2242-e202-46cc-8e1d-95b0f475726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c9b2242-e202-46cc-8e1d-95b0f475726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a3f4ed-b439-4c1e-b91c-961eb5c82995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:22 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Volume e98c5657-cdea-4283-9b13-d1971e8c46a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98c5657-cdea-4283-9b13-d1971e8c46a5', 'volume_size': 1} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1076811298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98c5657-cdea-4283-9b13-d1971e8c46a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb4223ff5cc0476393141fd31db7e223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:59:23Z,use_quota=True,user_id='0449998c67ba4eeea2b4ada47fd792ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Creating volume e98c5657-cdea-4283-9b13-d1971e8c46a5 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:59:22 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 05:59:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e98c5657-cdea-4283-9b13-d1971e8c46a5 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:22 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e98c5657-cdea-4283-9b13-d1971e8c46a5 1073741824 Jul 18 05:59:22 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:23 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e98c5657-cdea-4283-9b13-d1971e8c46a5 1073741824" returned: 0 in 0.681s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e98c5657-cdea-4283-9b13-d1971e8c46a5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:23 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e98c5657-cdea-4283-9b13-d1971e8c46a5 Jul 18 05:59:23 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:24 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e98c5657-cdea-4283-9b13-d1971e8c46a5" returned: 0 in 0.630s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a3f4ed-b439-4c1e-b91c-961eb5c82995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98c5657-cdea-4283-9b13-d1971e8c46a5', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a46d09b-aedd-4ca7-b472-65345d38b222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:24 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Volume volume-e98c5657-cdea-4283-9b13-d1971e8c46a5 (e98c5657-cdea-4283-9b13-d1971e8c46a5): created successfully Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a46d09b-aedd-4ca7-b472-65345d38b222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Flow 'volume_create_manager' (3cc376b3-50cc-4281-a780-2c9ad8c3ef02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:59:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a09b01d3-6f30-4fc7-bf2d-9bf54ea5273f tempest-ServerRescueNegativeTestJSON-1311409574 None] Created volume successfully. Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Acquiring lock "cinder-5f333c5e-215f-40cd-904a-0dad6c742061-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Lock "cinder-5f333c5e-215f-40cd-904a-0dad6c742061-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Acquiring lock "cinder-quobyte-5f333c5e-215f-40cd-904a-0dad6c742061" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Lock "cinder-quobyte-5f333c5e-215f-40cd-904a-0dad6c742061" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0573503b-539d-4218-ae5c-0f672e619c5c]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:59:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5f333c5e-215f-40cd-904a-0dad6c742061 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:25 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5f333c5e-215f-40cd-904a-0dad6c742061 Jul 18 05:59:25 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:25 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5f333c5e-215f-40cd-904a-0dad6c742061" returned: 0 in 0.624s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5f333c5e-215f-40cd-904a-0dad6c742061 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:25 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5f333c5e-215f-40cd-904a-0dad6c742061 Jul 18 05:59:25 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:26 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5f333c5e-215f-40cd-904a-0dad6c742061" returned: 0 in 0.533s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Lock "cinder-quobyte-5f333c5e-215f-40cd-904a-0dad6c742061" released by "delete_volume" :: held 1.228s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:59:26 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Created reservations ['3012656b-0c2b-4b64-91a0-2117d86ed5ad', '20f97c31-7054-4c93-ae72-efcb49cda963', '02726341-d81f-47c2-896f-62bd29748151', 'eff126fd-437a-4df3-a6cb-baf256ac4e25'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:59:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:59:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:59:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:26 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:59:26 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:26 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.485s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:26 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:59:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Deleted volume successfully. Jul 18 05:59:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-80d6379c-683d-401b-b9a8-84025abd2558 tempest-TaggedAttachmentsTest-1425330271 None] Lock "cinder-5f333c5e-215f-40cd-904a-0dad6c742061-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:59:27 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-170ee4ef-fe5d-452a-9998-56d405482fa4 req-abfcccab-32aa-486c-be0c-c3857de80254 tempest-ServerActionsTestOtherA-1048510294 None] Terminate volume connection completed successfully. Jul 18 05:59:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-170ee4ef-fe5d-452a-9998-56d405482fa4 req-abfcccab-32aa-486c-be0c-c3857de80254 tempest-ServerActionsTestOtherA-1048510294 None] Deleting attachment aaea2824-acdf-4202-b9fe-0fcfd88f08ca. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 05:59:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-170ee4ef-fe5d-452a-9998-56d405482fa4 req-2745cdfe-a7eb-402d-906b-a3bd7fdfadd6 tempest-ServerActionsTestOtherA-1048510294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-170ee4ef-fe5d-452a-9998-56d405482fa4 req-2745cdfe-a7eb-402d-906b-a3bd7fdfadd6 tempest-ServerActionsTestOtherA-1048510294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-170ee4ef-fe5d-452a-9998-56d405482fa4 req-2745cdfe-a7eb-402d-906b-a3bd7fdfadd6 tempest-ServerActionsTestOtherA-1048510294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-170ee4ef-fe5d-452a-9998-56d405482fa4 req-2745cdfe-a7eb-402d-906b-a3bd7fdfadd6 tempest-ServerActionsTestOtherA-1048510294 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-25dd01e5-eb31-4081-8d37-031ed92acc00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2748e52a-a874-401a-ba09-226593e5a402', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 05:59:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-170ee4ef-fe5d-452a-9998-56d405482fa4 req-2745cdfe-a7eb-402d-906b-a3bd7fdfadd6 tempest-ServerActionsTestOtherA-1048510294 None] attachment_update completed successfully. Jul 18 05:59:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 05:59:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:59:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:59:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:35 devstack sudo[91402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:59:35 devstack sudo[91402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:35 devstack sudo[91402]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.529s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:59:39 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=20,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:59:39 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=22,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 05:59:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Acquiring lock "cinder-e98c5657-cdea-4283-9b13-d1971e8c46a5-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:59:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Lock "cinder-e98c5657-cdea-4283-9b13-d1971e8c46a5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:59:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Acquiring lock "cinder-quobyte-e98c5657-cdea-4283-9b13-d1971e8c46a5" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 05:59:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Lock "cinder-quobyte-e98c5657-cdea-4283-9b13-d1971e8c46a5" acquired by "delete_volume" :: waited 0.042s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 05:59:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9089de-4248-4d42-875c-d4f2b7543595]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 05:59:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e98c5657-cdea-4283-9b13-d1971e8c46a5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:46 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e98c5657-cdea-4283-9b13-d1971e8c46a5 Jul 18 05:59:46 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:46 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e98c5657-cdea-4283-9b13-d1971e8c46a5" returned: 0 in 0.828s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e98c5657-cdea-4283-9b13-d1971e8c46a5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:46 devstack sudo[91490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e98c5657-cdea-4283-9b13-d1971e8c46a5 Jul 18 05:59:46 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:47 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e98c5657-cdea-4283-9b13-d1971e8c46a5" returned: 0 in 0.425s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Lock "cinder-quobyte-e98c5657-cdea-4283-9b13-d1971e8c46a5" released by "delete_volume" :: held 1.421s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:59:47 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Created reservations ['e9d461b1-6d69-482e-a9a3-b6fded251a3a', 'f5e6a1a8-70d1-4b40-9b0d-b948a075b4f6', '156c84c4-337f-4b40-98b8-b4334fc76c1b', '6c053d5f-1a1a-4b99-a517-91225e7cf168'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 05:59:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:59:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:59:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:47 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 05:59:47 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:48 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.488s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:48 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 05:59:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Deleted volume successfully. Jul 18 05:59:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-92450480-0aa3-4fbb-a44c-0e581f47c185 tempest-ServerRescueNegativeTestJSON-1311409574 None] Lock "cinder-e98c5657-cdea-4283-9b13-d1971e8c46a5-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Flow 'volume_create_manager' (e1e09d5e-88cc-4374-b99f-56b2c2c26238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c70f773-9d5c-44a4-b5bc-fb7b62d10486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c70f773-9d5c-44a4-b5bc-fb7b62d10486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1140121753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9bfcad-d7c0-45c9-b93b-22f2058e06dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69924a6f9780421ebc174042ac757653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:59:53Z,use_quota=True,user_id='775c22bb077b4309b3eb5b9dc9340c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99a2442-4c64-47fd-9b5e-29670b909cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99a2442-4c64-47fd-9b5e-29670b909cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f571de8-f463-4518-bed9-2b16f0f389a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f571de8-f463-4518-bed9-2b16f0f389a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9bfcad-d7c0-45c9-b93b-22f2058e06dd', 'volume_name': 'volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0d214a-da31-4dbf-8b02-19c274c4e366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d0d214a-da31-4dbf-8b02-19c274c4e366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194c53ab-b002-40dd-af5c-da514f5e315e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Volume df9bfcad-d7c0-45c9-b93b-22f2058e06dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd', 'volume_size': 1} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1140121753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9bfcad-d7c0-45c9-b93b-22f2058e06dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69924a6f9780421ebc174042ac757653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:59:53Z,use_quota=True,user_id='775c22bb077b4309b3eb5b9dc9340c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Creating volume df9bfcad-d7c0-45c9-b93b-22f2058e06dd {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:59:53 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:53 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd 1073741824 Jul 18 05:59:53 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:53 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd 1073741824" returned: 0 in 0.620s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:53 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd Jul 18 05:59:53 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:54 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd" returned: 0 in 0.307s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:59:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194c53ab-b002-40dd-af5c-da514f5e315e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc93d53e-494c-4a80-a3a1-86c23d4830bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Volume volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd (df9bfcad-d7c0-45c9-b93b-22f2058e06dd): created successfully Jul 18 05:59:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc93d53e-494c-4a80-a3a1-86c23d4830bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Flow 'volume_create_manager' (e1e09d5e-88cc-4374-b99f-56b2c2c26238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:59:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-74807c55-31b0-4977-be09-e5e676b17ebd tempest-VolumesTestJSON-1382738245 None] Created volume successfully. Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Flow 'volume_create_manager' (397510a3-a4f1-4403-9897-bd763ac2b72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4248506e-7840-460b-8149-03649d0d4000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4248506e-7840-460b-8149-03649d0d4000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-534501115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9efb1ab8-d12f-4f31-a746-a3ff99ded2f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69924a6f9780421ebc174042ac757653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:59:56Z,use_quota=True,user_id='775c22bb077b4309b3eb5b9dc9340c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f8bce9-ef42-46a3-a61a-a7746a24819f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94f8bce9-ef42-46a3-a61a-a7746a24819f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681b92b2-8dbe-471a-af4f-8a34b36c9d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (681b92b2-8dbe-471a-af4f-8a34b36c9d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9efb1ab8-d12f-4f31-a746-a3ff99ded2f0', 'volume_name': 'volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df63b54e-6fd4-435f-915e-200c76e23449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df63b54e-6fd4-435f-915e-200c76e23449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b91409c-b356-460f-b47e-8d1a66a1418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:55 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Volume 9efb1ab8-d12f-4f31-a746-a3ff99ded2f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0', 'volume_size': 1} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-534501115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9efb1ab8-d12f-4f31-a746-a3ff99ded2f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69924a6f9780421ebc174042ac757653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:59:56Z,use_quota=True,user_id='775c22bb077b4309b3eb5b9dc9340c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Creating volume 9efb1ab8-d12f-4f31-a746-a3ff99ded2f0 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:59:55 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 05:59:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:56 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0 1073741824 Jul 18 05:59:56 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:56 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0 1073741824" returned: 0 in 0.509s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:56 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0 Jul 18 05:59:56 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:56 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0" returned: 0 in 0.254s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:59:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b91409c-b356-460f-b47e-8d1a66a1418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ab0414-5fb3-49ff-8ce1-fc17e007720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:56 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Volume volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0 (9efb1ab8-d12f-4f31-a746-a3ff99ded2f0): created successfully Jul 18 05:59:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ab0414-5fb3-49ff-8ce1-fc17e007720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Flow 'volume_create_manager' (397510a3-a4f1-4403-9897-bd763ac2b72e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:59:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-739b700f-23f4-469f-9c22-02bf497096ab tempest-VolumesTestJSON-1382738245 None] Created volume successfully. Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Flow 'volume_create_manager' (ffeeb989-1317-494c-850d-33deb713fa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202a75db-9038-49e4-8857-34e002d11198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202a75db-9038-49e4-8857-34e002d11198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1932840608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0740142d-336f-4035-afdd-34c0f11cae3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69924a6f9780421ebc174042ac757653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:59:59Z,use_quota=True,user_id='775c22bb077b4309b3eb5b9dc9340c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5762dcc5-9a91-4028-8751-e52ddbd71dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5762dcc5-9a91-4028-8751-e52ddbd71dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508f6d3d-a882-4527-ae40-7310fd965058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508f6d3d-a882-4527-ae40-7310fd965058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0740142d-336f-4035-afdd-34c0f11cae3d', 'volume_name': 'volume-0740142d-336f-4035-afdd-34c0f11cae3d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365e9185-67b5-455b-ada5-88c21cacdc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365e9185-67b5-455b-ada5-88c21cacdc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83862285-7c87-4416-8f8c-fa365f8b798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Volume 0740142d-336f-4035-afdd-34c0f11cae3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0740142d-336f-4035-afdd-34c0f11cae3d', 'volume_size': 1} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T03:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1932840608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0740142d-336f-4035-afdd-34c0f11cae3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='69924a6f9780421ebc174042ac757653',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T03:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T03:59:59Z,use_quota=True,user_id='775c22bb077b4309b3eb5b9dc9340c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Creating volume 0740142d-336f-4035-afdd-34c0f11cae3d {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 05:59:58 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 05:59:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0740142d-336f-4035-afdd-34c0f11cae3d 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:58 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0740142d-336f-4035-afdd-34c0f11cae3d 1073741824 Jul 18 05:59:58 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:59 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0740142d-336f-4035-afdd-34c0f11cae3d 1073741824" returned: 0 in 0.675s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0740142d-336f-4035-afdd-34c0f11cae3d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 05:59:59 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0740142d-336f-4035-afdd-34c0f11cae3d Jul 18 05:59:59 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 05:59:59 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Jul 18 05:59:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0740142d-336f-4035-afdd-34c0f11cae3d" returned: 0 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 05:59:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 05:59:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 05:59:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83862285-7c87-4416-8f8c-fa365f8b798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0740142d-336f-4035-afdd-34c0f11cae3d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175d4c63-bc9a-4904-949b-87e86c2e9789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 05:59:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Volume volume-0740142d-336f-4035-afdd-34c0f11cae3d (0740142d-336f-4035-afdd-34c0f11cae3d): created successfully Jul 18 05:59:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175d4c63-bc9a-4904-949b-87e86c2e9789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 05:59:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Flow 'volume_create_manager' (ffeeb989-1317-494c-850d-33deb713fa15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:00:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-91b478e4-ab3e-4638-99ac-61eb66a4f889 tempest-VolumesTestJSON-1382738245 None] Created volume successfully. Jul 18 06:00:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Acquiring lock "cinder-0740142d-336f-4035-afdd-34c0f11cae3d-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:00:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Lock "cinder-0740142d-336f-4035-afdd-34c0f11cae3d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:00:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Acquiring lock "cinder-quobyte-0740142d-336f-4035-afdd-34c0f11cae3d" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:00:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Lock "cinder-quobyte-0740142d-336f-4035-afdd-34c0f11cae3d" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:00:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b1f92e-c481-4dcf-b298-4624734153e5]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:00:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0740142d-336f-4035-afdd-34c0f11cae3d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:02 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0740142d-336f-4035-afdd-34c0f11cae3d Jul 18 06:00:02 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-b7e3c1b8-17d7-4a99-91a4-d292122240ec req-e6f62b57-8446-4952-91d5-bec032181608 tempest-ServerActionsTestOtherA-1048510294 None] Terminate volume connection completed successfully. Jul 18 06:00:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-b7e3c1b8-17d7-4a99-91a4-d292122240ec req-e6f62b57-8446-4952-91d5-bec032181608 tempest-ServerActionsTestOtherA-1048510294 None] Deleting attachment 2748e52a-a874-401a-ba09-226593e5a402. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:00:03 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0740142d-336f-4035-afdd-34c0f11cae3d" returned: 0 in 0.636s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0740142d-336f-4035-afdd-34c0f11cae3d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:03 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0740142d-336f-4035-afdd-34c0f11cae3d Jul 18 06:00:03 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:03 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0740142d-336f-4035-afdd-34c0f11cae3d" returned: 0 in 0.296s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Lock "cinder-quobyte-0740142d-336f-4035-afdd-34c0f11cae3d" released by "delete_volume" :: held 1.006s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:00:03 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Created reservations ['60e8dc45-062f-45cf-b257-f2f4c047508c', '4841da95-5457-4092-995e-4b93f5d8b664', 'b62e6e40-efb9-4eb4-b437-495cac8bfe8e', '935bbb3d-22c8-4d2c-bf35-ef0ca5c8a703'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:00:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:00:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:00:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:03 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:00:03 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:04 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.452s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:04 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:00:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Deleted volume successfully. Jul 18 06:00:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-02ae93f0-786c-4adf-b791-acc71da76766 tempest-VolumesTestJSON-1382738245 None] Lock "cinder-0740142d-336f-4035-afdd-34c0f11cae3d-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:00:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Acquiring lock "cinder-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:00:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Lock "cinder-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:00:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Acquiring lock "cinder-quobyte-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:00:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Lock "cinder-quobyte-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:00:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa7cf0b-9d2d-481a-913f-c4156180b623]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:00:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:05 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0 Jul 18 06:00:05 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:05 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0" returned: 0 in 0.602s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:05 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0 Jul 18 06:00:05 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:06 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0" returned: 0 in 0.293s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Lock "cinder-quobyte-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0" released by "delete_volume" :: held 0.983s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:00:06 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Created reservations ['362bb160-ee98-4525-8fe4-c391cfd41b32', 'ba7b65c4-98d0-4977-93fe-d533567c157d', 'fddff164-0028-4cea-8a88-c2ae9f845215', 'c4fabb3c-4884-43d1-939d-ce7db62a257b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:00:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:00:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:00:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:06 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:00:06 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:06 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.286s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:06 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:00:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Deleted volume successfully. Jul 18 06:00:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e016fc59-1556-4a6b-8a51-9702f0ae5471 tempest-VolumesTestJSON-1382738245 None] Lock "cinder-9efb1ab8-d12f-4f31-a746-a3ff99ded2f0-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:00:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Acquiring lock "cinder-df9bfcad-d7c0-45c9-b93b-22f2058e06dd-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:00:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Lock "cinder-df9bfcad-d7c0-45c9-b93b-22f2058e06dd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:00:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Acquiring lock "cinder-quobyte-df9bfcad-d7c0-45c9-b93b-22f2058e06dd" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:00:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Lock "cinder-quobyte-df9bfcad-d7c0-45c9-b93b-22f2058e06dd" acquired by "delete_volume" :: waited 0.046s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:00:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4df7ed8-2e55-498d-b5a0-c6a0ffc498db]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:00:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:07 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd Jul 18 06:00:07 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:08 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd" returned: 0 in 0.441s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:08 devstack sudo[91712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd Jul 18 06:00:08 devstack sudo[91712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:08 devstack sudo[91712]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-df9bfcad-d7c0-45c9-b93b-22f2058e06dd" returned: 0 in 0.340s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Lock "cinder-quobyte-df9bfcad-d7c0-45c9-b93b-22f2058e06dd" released by "delete_volume" :: held 0.834s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Created reservations ['039b83da-60ad-44a1-9736-619a3424ff93', '2c6f30f4-bf35-43e5-b682-343d4dc26ee3', 'c6aa6066-c141-41ff-b04f-e9b955479517', 'ecedf5a7-7989-4737-8b8d-068b3abf4951'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:08 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:00:08 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:08 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.324s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:00:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Deleted volume successfully. Jul 18 06:00:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77e8e7ee-783d-4d8a-830b-28809efe8b1b tempest-VolumesTestJSON-1382738245 None] Lock "cinder-df9bfcad-d7c0-45c9-b93b-22f2058e06dd-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:00:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Acquiring lock "cinder-25dd01e5-eb31-4081-8d37-031ed92acc00-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:00:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Lock "cinder-25dd01e5-eb31-4081-8d37-031ed92acc00-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:00:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Acquiring lock "cinder-quobyte-25dd01e5-eb31-4081-8d37-031ed92acc00" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:00:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Lock "cinder-quobyte-25dd01e5-eb31-4081-8d37-031ed92acc00" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:00:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d875dc80-a05f-4c2f-90bc-216a6ae56181]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:00:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-25dd01e5-eb31-4081-8d37-031ed92acc00 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:09 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-25dd01e5-eb31-4081-8d37-031ed92acc00 Jul 18 06:00:09 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:10 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-25dd01e5-eb31-4081-8d37-031ed92acc00" returned: 0 in 0.446s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-25dd01e5-eb31-4081-8d37-031ed92acc00 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:10 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-25dd01e5-eb31-4081-8d37-031ed92acc00 Jul 18 06:00:10 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:10 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-25dd01e5-eb31-4081-8d37-031ed92acc00" returned: 0 in 0.260s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Lock "cinder-quobyte-25dd01e5-eb31-4081-8d37-031ed92acc00" released by "delete_volume" :: held 0.753s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Created reservations ['48d2f204-425c-455a-a0e6-39a6bed51f62', '4f57fc94-81c0-4e19-ab6d-bb27ec296a00', '6c23dcbc-799a-4106-ac41-953a381a8cc7', '24bd5353-a4d2-4a50-b13b-0f63bff4ceab'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:10 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:00:10 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:10 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.295s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:10 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:00:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Deleted volume successfully. Jul 18 06:00:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e2d871e4-bf84-4db5-ba73-564618f18bd0 tempest-ServerActionsTestOtherA-1048510294 None] Lock "cinder-25dd01e5-eb31-4081-8d37-031ed92acc00-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:00:20 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=44,cinder:SELECT=32,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:00:21 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=32,cinder:INSERT=13,cinder:UPDATE=54,cinder:DELETE=4 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:00:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d84ab0c8-46f4-4450-8cd8-5334a0933ddd tempest-GroupsV314Test-1000636323 None] Group tempest-GroupsV314Test-Group-808526308: creating Jul 18 06:00:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d84ab0c8-46f4-4450-8cd8-5334a0933ddd tempest-GroupsV314Test-1000636323 None] Group tempest-GroupsV314Test-Group-808526308: created successfully Jul 18 06:00:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d84ab0c8-46f4-4450-8cd8-5334a0933ddd tempest-GroupsV314Test-1000636323 None] Create group completed successfully. Jul 18 06:00:23 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:00:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Flow 'volume_create_manager' (f8107730-4062-4cd5-b5f4-e2aa0552fd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac15f504-06d3-48c1-a015-16cd3a391601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac15f504-06d3-48c1-a015-16cd3a391601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-200733734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=395f92a2-8d33-4484-9228-acfd1da86ee4,host='devstack@QuobyteHD#QuobyteHD',id=714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df606908d28b473599cb2dfb2c657ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:00:24Z,use_quota=True,user_id='0185bbdf90e647c3b38b9511fb1d5656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bf714fe-2942-4d85-91ef-7ade802e8516),volume_type_id=4bf714fe-2942-4d85-91ef-7ade802e8516)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d3194b-ea19-4a61-b23f-26f1645af648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d3194b-ea19-4a61-b23f-26f1645af648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f97778-6b35-4c36-b66d-b3c1cd6c1cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f97778-6b35-4c36-b66d-b3c1cd6c1cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf', 'volume_name': 'volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d139ee7e-9d97-4c94-b774-ccc2bfacb74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d139ee7e-9d97-4c94-b774-ccc2bfacb74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f297e85b-9146-4cbb-a4b6-ed9f44a40ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:00:24 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Volume 714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf', 'volume_size': 1} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=395f92a2-8d33-4484-9228-acfd1da86ee4,created_at=2026-07-18T04:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-200733734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=395f92a2-8d33-4484-9228-acfd1da86ee4,host='devstack@QuobyteHD#QuobyteHD',id=714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df606908d28b473599cb2dfb2c657ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:00:24Z,use_quota=True,user_id='0185bbdf90e647c3b38b9511fb1d5656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4bf714fe-2942-4d85-91ef-7ade802e8516),volume_type_id=4bf714fe-2942-4d85-91ef-7ade802e8516)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Creating volume 714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:00:24 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:24 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf 1073741824 Jul 18 06:00:24 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:24 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf 1073741824" returned: 0 in 0.547s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:24 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf Jul 18 06:00:24 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:25 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf" returned: 0 in 0.537s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:00:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f297e85b-9146-4cbb-a4b6-ed9f44a40ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:00:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1cf316-b488-49d7-9366-301e438a521f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:00:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Volume volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf (714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf): created successfully Jul 18 06:00:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1cf316-b488-49d7-9366-301e438a521f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:00:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Flow 'volume_create_manager' (f8107730-4062-4cd5-b5f4-e2aa0552fd62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:00:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-be14c095-5533-4cfe-ba17-3fde10a6ea25 tempest-GroupsV314Test-1000636323 None] Created volume successfully. Jul 18 06:00:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:27 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Cloning volume 714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf to volume 3f9f860c-13c7-4a0a-abd3-136c9edf3940 Jul 18 06:00:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Creating offline snapshot ce99069c-16ae-461c-ac49-2e1d49914403 of volume 714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:00:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cab05af-9830-4f0d-b9c3-503ad8089623]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:00:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:27 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf Jul 18 06:00:27 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:28 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf" returned: 0 in 0.509s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:28 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 1G Jul 18 06:00:28 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:28 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 1G" returned: 0 in 0.422s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:28 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 Jul 18 06:00:28 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:29 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403" returned: 0 in 0.461s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:29 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:00:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:29 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 Jul 18 06:00:29 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:29 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403" returned: 0 in 0.353s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:29 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.info Jul 18 06:00:29 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:29 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.info" returned: 0 in 0.289s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:29 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.info is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:00:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:29 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.info Jul 18 06:00:29 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:30 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.info" returned: 0 in 0.515s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Acquiring lock "cinder-quobyte-3f9f860c-13c7-4a0a-abd3-136c9edf3940" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Lock "cinder-quobyte-3f9f860c-13c7-4a0a-abd3-136c9edf3940" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] snapshot: ce99069c-16ae-461c-ac49-2e1d49914403, volume: 3f9f860c-13c7-4a0a-abd3-136c9edf3940, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[90346413-a809-4555-866b-204b1b35ed95]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:30 devstack sudo[91910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 Jul 18 06:00:30 devstack sudo[91910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:30 devstack sudo[91910]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403" returned: 0 in 0.499s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed285cc-753d-4453-b5f2-2ed395335ed5]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:00:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:31 devstack sudo[91923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf Jul 18 06:00:31 devstack sudo[91923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:31 devstack sudo[91923]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf" returned: 0 in 0.607s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:31 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Path /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 06:00:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:31 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940 Jul 18 06:00:31 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:00:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:00:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:00:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:35 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:00:35 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:35 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.729s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:00:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:00:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 8 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:00:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:00:39 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940" returned: 0 in 7.566s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:39 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a491fc3-8137-4953-84fc-03b7555792f3]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:00:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:39 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf Jul 18 06:00:39 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:39 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:00:39 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:00:39 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf" returned: 0 in 0.690s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:39 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:00:39 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Converted 1024.00 MB image at 135.31 MB/s Jul 18 06:00:39 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940 is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:00:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:39 devstack sudo[92093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940 Jul 18 06:00:39 devstack sudo[92093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:40 devstack sudo[92093]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940" returned: 0 in 0.307s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Lock "cinder-quobyte-3f9f860c-13c7-4a0a-abd3-136c9edf3940" released by "_copy_volume_from_snapshot" :: held 9.804s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:00:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Acquiring lock "cinder-quobyte-ce99069c-16ae-461c-ac49-2e1d49914403" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:00:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Lock "cinder-quobyte-ce99069c-16ae-461c-ac49-2e1d49914403" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:00:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Deleting offline snapshot ce99069c-16ae-461c-ac49-2e1d49914403 of volume 714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:00:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] snapshot_file for this snap is: volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:00:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19fbd3f-b394-4e51-8ba4-9e5c27e596aa]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:00:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:40 devstack sudo[92096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 Jul 18 06:00:40 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:41 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403" returned: 0 in 0.733s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:00:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e867fce-8650-40d4-9c91-dff8f5d1fa1f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:00:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:41 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf Jul 18 06:00:41 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:41 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf" returned: 0 in 0.510s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:41 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 Jul 18 06:00:41 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:42 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403" returned: 0 in 0.502s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:42 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403 Jul 18 06:00:42 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:42 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf.ce99069c-16ae-461c-ac49-2e1d49914403" returned: 0 in 0.434s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Lock "cinder-quobyte-ce99069c-16ae-461c-ac49-2e1d49914403" released by "_delete_snapshot" :: held 2.328s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:00:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.047s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:42 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7a6c79a7-9e0d-4bdf-832d-e4e2ee5b0871 tempest-GroupsV314Test-1000636323 None] Create group from source-group-395f92a2-8d33-4484-9228-acfd1da86ee4 completed successfully. Jul 18 06:00:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Acquiring lock "cinder-quobyte-3f9f860c-13c7-4a0a-abd3-136c9edf3940" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:00:44 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Lock "cinder-quobyte-3f9f860c-13c7-4a0a-abd3-136c9edf3940" acquired by "delete_volume" :: waited 0.050s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:00:44 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[35daedc2-b98f-40d3-9e64-93f8304041f2]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:00:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:44 devstack sudo[92119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940 Jul 18 06:00:44 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:44 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940" returned: 0 in 0.547s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:44 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940 Jul 18 06:00:44 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:45 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3f9f860c-13c7-4a0a-abd3-136c9edf3940" returned: 0 in 0.593s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Lock "cinder-quobyte-3f9f860c-13c7-4a0a-abd3-136c9edf3940" released by "delete_volume" :: held 1.248s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:00:45 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Created reservations ['43ff5123-a9c4-4f9e-8d26-d1b33f1aa624'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:00:45 devstack cinder-volume[87750]: WARNING cinder.quota [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1236804513 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1236804513, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:00:45 devstack cinder-volume[87750]: WARNING cinder.quota [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1236804513 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1236804513, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:00:45 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Created reservations ['bbfb3bf0-4a6d-4ab5-a09a-1a2efe28279d', 'c76ecbb6-c0ce-4b90-b0b4-73e1fcb01233', '636a6df1-75bb-4861-9065-09c495d0b9d1', '55dca8e2-fe8b-4bcb-9f34-372298400f42'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:00:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:00:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:00:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:45 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:00:45 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:46 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.360s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:46 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:00:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4b357ce8-1db2-4eec-ae69-fe569de8cd0d tempest-GroupsV314Test-1000636323 None] Delete group completed successfully. Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Acquiring lock "cinder-quobyte-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Lock "cinder-quobyte-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3a9313-697a-4b26-a5d7-2441d0af6fb6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:00:47 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf Jul 18 06:00:47 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Flow 'volume_create_manager' (010b3fae-aaf7-4b40-9b05-ac18de5b6ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4138fdf-63c1-4cfd-bc24-ac7bf93e82bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4138fdf-63c1-4cfd-bc24-ac7bf93e82bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1133104457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fdfb3f-df2f-4933-8b6d-15a592265519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a9335f0acf49ce938708df9674c127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:00:48Z,use_quota=True,user_id='65d243b61af04ecfaa7871027af52527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe35361-cca2-47c0-8e2d-7159a0573988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abe35361-cca2-47c0-8e2d-7159a0573988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be64ed2-6f6f-4a96-9fa3-c094fe3be7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be64ed2-6f6f-4a96-9fa3-c094fe3be7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8fdfb3f-df2f-4933-8b6d-15a592265519', 'volume_name': 'volume-f8fdfb3f-df2f-4933-8b6d-15a592265519', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5db38d-2816-4caf-83bd-485826a5c6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5db38d-2816-4caf-83bd-485826a5c6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a9f7f0-3d3c-4e74-9b65-07ccbbc3651e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:00:47 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Volume f8fdfb3f-df2f-4933-8b6d-15a592265519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8fdfb3f-df2f-4933-8b6d-15a592265519', 'volume_size': 1} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1133104457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fdfb3f-df2f-4933-8b6d-15a592265519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a9335f0acf49ce938708df9674c127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:00:48Z,use_quota=True,user_id='65d243b61af04ecfaa7871027af52527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Creating volume f8fdfb3f-df2f-4933-8b6d-15a592265519 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:00:47 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:00:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f8fdfb3f-df2f-4933-8b6d-15a592265519 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:47 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f8fdfb3f-df2f-4933-8b6d-15a592265519 1073741824 Jul 18 06:00:47 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:48 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf" returned: 0 in 0.504s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:48 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf Jul 18 06:00:48 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:48 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf" returned: 0 in 0.336s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Lock "cinder-quobyte-714c4c4a-a210-4f0e-bcd9-5ca91e4c5bdf" released by "delete_volume" :: held 0.967s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:00:48 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f8fdfb3f-df2f-4933-8b6d-15a592265519 1073741824" returned: 0 in 0.665s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Created reservations ['d7b02295-9df8-40fc-bb95-e17d806c08a8'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f8fdfb3f-df2f-4933-8b6d-15a592265519 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Created reservations ['58494b2d-9672-4b63-9621-5459459b5332', '94f9874d-cc35-4303-a45b-3cb7f81923a3', '5bb6a3d4-2ba3-46d5-bcbb-c89cae04d796', '94b47cbe-3ba5-4e34-9332-1dbcb98c607a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:00:48 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f8fdfb3f-df2f-4933-8b6d-15a592265519 Jul 18 06:00:48 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:00:48 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:00:48 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:00:49 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f8fdfb3f-df2f-4933-8b6d-15a592265519" returned: 0 in 0.541s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:00:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:00:49 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Jul 18 06:00:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.345s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:00:49 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:00:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57a9f7f0-3d3c-4e74-9b65-07ccbbc3651e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8fdfb3f-df2f-4933-8b6d-15a592265519', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:00:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f4b20c-e254-436d-940a-fb06779c1a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:00:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-bb22965e-aacc-4807-8c96-53d8d6ab027f tempest-GroupsV314Test-1000636323 None] Delete group completed successfully. Jul 18 06:00:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Volume volume-f8fdfb3f-df2f-4933-8b6d-15a592265519 (f8fdfb3f-df2f-4933-8b6d-15a592265519): created successfully Jul 18 06:00:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f4b20c-e254-436d-940a-fb06779c1a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:00:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Flow 'volume_create_manager' (010b3fae-aaf7-4b40-9b05-ac18de5b6ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:00:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5dc2a8b3-f8e9-40a9-9f27-468b64686c2f tempest-AttachVolumeShelveTestJSON-1145163087 None] Created volume successfully. Jul 18 06:00:59 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=24,cinder:SELECT=20,cinder:INSERT=6 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:00:59 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=32,cinder:SELECT=21,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-259c7ec0-253e-43ab-8d6d-a17ac159c1a3 req-19d81a6b-c562-4fcf-bd2a-353134bcb91b tempest-AttachVolumeShelveTestJSON-1145163087 None] No connector for attachment 6ecb03ca-4628-431d-9c9b-112f1eff96d5; skipping storage backend terminate_connection call. {{(pid=87750) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-259c7ec0-253e-43ab-8d6d-a17ac159c1a3 req-19d81a6b-c562-4fcf-bd2a-353134bcb91b tempest-AttachVolumeShelveTestJSON-1145163087 None] Deleting attachment 6ecb03ca-4628-431d-9c9b-112f1eff96d5. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Flow 'volume_create_manager' (23cc6770-864a-41fc-a6f9-5b19b0962c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17d8efe-ea5d-4099-8a52-23ecbb60572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17d8efe-ea5d-4099-8a52-23ecbb60572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-182375189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9586d6-c159-414f-a4df-56763023f6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a32090ce18545ca93124d5855db211d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:03Z,use_quota=True,user_id='a4ae47bb938247beb2444e763edb58f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53405ba5-730e-4109-ade5-1ffefbcfbd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53405ba5-730e-4109-ade5-1ffefbcfbd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbdbcb1-c533-407a-94a2-d49350fd6e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbdbcb1-c533-407a-94a2-d49350fd6e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef9586d6-c159-414f-a4df-56763023f6cd', 'volume_name': 'volume-ef9586d6-c159-414f-a4df-56763023f6cd', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f42c3b-70f4-48ec-9eca-959da02e8772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f42c3b-70f4-48ec-9eca-959da02e8772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9620172-ba39-4d96-ac7f-2ae633eda059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Volume ef9586d6-c159-414f-a4df-56763023f6cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef9586d6-c159-414f-a4df-56763023f6cd', 'volume_size': 1} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-182375189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9586d6-c159-414f-a4df-56763023f6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a32090ce18545ca93124d5855db211d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:03Z,use_quota=True,user_id='a4ae47bb938247beb2444e763edb58f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Creating volume ef9586d6-c159-414f-a4df-56763023f6cd {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:01:03 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:01:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ef9586d6-c159-414f-a4df-56763023f6cd 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:03 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ef9586d6-c159-414f-a4df-56763023f6cd 1073741824 Jul 18 06:01:03 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:04 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ef9586d6-c159-414f-a4df-56763023f6cd 1073741824" returned: 0 in 1.036s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ef9586d6-c159-414f-a4df-56763023f6cd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:04 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ef9586d6-c159-414f-a4df-56763023f6cd Jul 18 06:01:04 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:05 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ef9586d6-c159-414f-a4df-56763023f6cd" returned: 0 in 0.746s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:01:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9620172-ba39-4d96-ac7f-2ae633eda059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9586d6-c159-414f-a4df-56763023f6cd', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e15e32d-2f00-4949-97c7-bd593a692b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:05 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Volume volume-ef9586d6-c159-414f-a4df-56763023f6cd (ef9586d6-c159-414f-a4df-56763023f6cd): created successfully Jul 18 06:01:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e15e32d-2f00-4949-97c7-bd593a692b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Flow 'volume_create_manager' (23cc6770-864a-41fc-a6f9-5b19b0962c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f7fb3570-603c-42d1-b2ed-ed2e7c547a58 tempest-AttachVolumeTestJSON-231829717 None] Created volume successfully. Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Flow 'volume_create_manager' (079b5f90-4450-4683-867e-2f136aaf697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7acf369-e358-469d-a9b7-9404e7032a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7acf369-e358-469d-a9b7-9404e7032a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2100441237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981268fa-bb31-451a-b8ae-134660490469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a813034c627849a09abc0553c8f84ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:06Z,use_quota=True,user_id='8515b5e1318d41318e6fdba688ce6934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4192e1b3-5a82-4061-b0b0-494b2297429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4192e1b3-5a82-4061-b0b0-494b2297429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (689b9a4b-0b8c-4b04-8d80-72a04659ac2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (689b9a4b-0b8c-4b04-8d80-72a04659ac2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981268fa-bb31-451a-b8ae-134660490469', 'volume_name': 'volume-981268fa-bb31-451a-b8ae-134660490469', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d579be5-862f-4b39-ac55-4c7a54addb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d579be5-862f-4b39-ac55-4c7a54addb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae77c1a5-ae09-4c7a-af6e-faa1bb6df27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:06 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Volume 981268fa-bb31-451a-b8ae-134660490469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981268fa-bb31-451a-b8ae-134660490469', 'volume_size': 1} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2100441237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981268fa-bb31-451a-b8ae-134660490469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a813034c627849a09abc0553c8f84ef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:06Z,use_quota=True,user_id='8515b5e1318d41318e6fdba688ce6934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Creating volume 981268fa-bb31-451a-b8ae-134660490469 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:01:06 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:01:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-981268fa-bb31-451a-b8ae-134660490469 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:06 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-981268fa-bb31-451a-b8ae-134660490469 1073741824 Jul 18 06:01:06 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:07 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-981268fa-bb31-451a-b8ae-134660490469 1073741824" returned: 0 in 0.649s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-981268fa-bb31-451a-b8ae-134660490469 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:07 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-981268fa-bb31-451a-b8ae-134660490469 Jul 18 06:01:07 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:07 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-981268fa-bb31-451a-b8ae-134660490469" returned: 0 in 0.440s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:01:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae77c1a5-ae09-4c7a-af6e-faa1bb6df27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981268fa-bb31-451a-b8ae-134660490469', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a836ada-35e3-47c2-acca-826540a70e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:07 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Volume volume-981268fa-bb31-451a-b8ae-134660490469 (981268fa-bb31-451a-b8ae-134660490469): created successfully Jul 18 06:01:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a836ada-35e3-47c2-acca-826540a70e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Flow 'volume_create_manager' (079b5f90-4450-4683-867e-2f136aaf697d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-296c4c2f-e59c-4fc9-ac3d-9a55f1288f05 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Created volume successfully. Jul 18 06:01:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-9f12932a-611f-4a88-9e99-c6e61b6a2669 req-b8e9f978-1bc2-4803-a4c9-f2b5c7b34dd9 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-9f12932a-611f-4a88-9e99-c6e61b6a2669 req-b8e9f978-1bc2-4803-a4c9-f2b5c7b34dd9 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-9f12932a-611f-4a88-9e99-c6e61b6a2669 req-b8e9f978-1bc2-4803-a4c9-f2b5c7b34dd9 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-9f12932a-611f-4a88-9e99-c6e61b6a2669 req-b8e9f978-1bc2-4803-a4c9-f2b5c7b34dd9 tempest-AttachVolumeTestJSON-231829717 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-ef9586d6-c159-414f-a4df-56763023f6cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ffb1f17-b702-4d70-b31d-282d2dc90680', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:01:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-9f12932a-611f-4a88-9e99-c6e61b6a2669 req-b8e9f978-1bc2-4803-a4c9-f2b5c7b34dd9 tempest-AttachVolumeTestJSON-231829717 None] attachment_update completed successfully. Jul 18 06:01:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Acquiring lock "cinder-981268fa-bb31-451a-b8ae-134660490469-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:01:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Lock "cinder-981268fa-bb31-451a-b8ae-134660490469-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:01:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Acquiring lock "cinder-quobyte-981268fa-bb31-451a-b8ae-134660490469" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:01:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Lock "cinder-quobyte-981268fa-bb31-451a-b8ae-134660490469" acquired by "delete_volume" :: waited 0.039s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:01:10 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[425f267f-8c48-45ab-a876-932c2b537637]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:01:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-981268fa-bb31-451a-b8ae-134660490469 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:10 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-981268fa-bb31-451a-b8ae-134660490469 Jul 18 06:01:10 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:11 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-981268fa-bb31-451a-b8ae-134660490469" returned: 0 in 1.253s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-981268fa-bb31-451a-b8ae-134660490469 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:11 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-981268fa-bb31-451a-b8ae-134660490469 Jul 18 06:01:11 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:12 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-981268fa-bb31-451a-b8ae-134660490469" returned: 0 in 0.608s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Lock "cinder-quobyte-981268fa-bb31-451a-b8ae-134660490469" released by "delete_volume" :: held 1.974s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:01:12 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Created reservations ['d04699cb-ba99-4c2e-84dd-db2ae48eb4d1', '7f717d27-5dea-47d5-b387-0b5ad1876b31', '50ead815-f1aa-4c4f-8341-e3fced8914d6', '8c3570b6-75c3-4a22-90b9-d30d15f15ae5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:01:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:12 devstack sudo[92865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:01:12 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:13 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.592s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:13 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:01:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Deleted volume successfully. Jul 18 06:01:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5489c4c5-6d0a-40ba-ac52-52328a80a8a4 tempest-VolumeQuotasNegativeTestJSON-978707088 None] Lock "cinder-981268fa-bb31-451a-b8ae-134660490469-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Flow 'volume_create_manager' (d2e8b701-a0f4-4ad3-8eb5-da27d6e58f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f6bcf5-9068-4d2a-9393-4a91ee0dea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f6bcf5-9068-4d2a-9393-4a91ee0dea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1465438699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9b9230-d2ed-46c4-b9e7-fdb2470a2365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19d59b5859c49418b7857b877b2ae0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:20Z,use_quota=True,user_id='30157f6ab5b0423e893bfba3cc012352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e8d176-d829-43ad-ba7e-f0072f1e0621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e8d176-d829-43ad-ba7e-f0072f1e0621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88407b54-e5c3-4675-af77-ddbe5c105b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88407b54-e5c3-4675-af77-ddbe5c105b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a9b9230-d2ed-46c4-b9e7-fdb2470a2365', 'volume_name': 'volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239d4b2e-1515-4b1d-a93b-16946832fb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239d4b2e-1515-4b1d-a93b-16946832fb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07796e5a-e514-44f9-bc35-ca49db71c489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Volume 5a9b9230-d2ed-46c4-b9e7-fdb2470a2365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365', 'volume_size': 1} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1465438699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9b9230-d2ed-46c4-b9e7-fdb2470a2365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19d59b5859c49418b7857b877b2ae0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:20Z,use_quota=True,user_id='30157f6ab5b0423e893bfba3cc012352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Creating volume 5a9b9230-d2ed-46c4-b9e7-fdb2470a2365 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:01:20 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:01:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:20 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365 1073741824 Jul 18 06:01:20 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:21 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365 1073741824" returned: 0 in 0.579s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:24 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365 Jul 18 06:01:24 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:25 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365" returned: 0 in 0.592s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] <== create_volume: return (4748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:01:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.751s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07796e5a-e514-44f9-bc35-ca49db71c489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dff40e-a373-4292-bc13-90428f467972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Volume volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365 (5a9b9230-d2ed-46c4-b9e7-fdb2470a2365): created successfully Jul 18 06:01:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dff40e-a373-4292-bc13-90428f467972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Flow 'volume_create_manager' (d2e8b701-a0f4-4ad3-8eb5-da27d6e58f9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2b3575d7-84d6-43d8-b0e3-e930adb37bb0 tempest-ServersNegativeTestJSON-1156818397 None] Created volume successfully. Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Flow 'volume_create_manager' (2871a96b-bce4-45ea-985b-854fd0ca885d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28cf46d-9efb-43bb-b31e-c1c6b4ee7a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28cf46d-9efb-43bb-b31e-c1c6b4ee7a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1999805805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294d8a4b-a243-470f-8d4b-7ef97c038fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19d59b5859c49418b7857b877b2ae0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:28Z,use_quota=True,user_id='30157f6ab5b0423e893bfba3cc012352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ff3aad-1888-4c61-abd3-c524853bcefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ff3aad-1888-4c61-abd3-c524853bcefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b968e7d1-3495-4a3a-972e-618c60a19fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b968e7d1-3495-4a3a-972e-618c60a19fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294d8a4b-a243-470f-8d4b-7ef97c038fd5', 'volume_name': 'volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee61906-27e6-481a-867d-9dd1a52a05df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee61906-27e6-481a-867d-9dd1a52a05df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb34636-621b-4e95-898a-cc27e542bdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:28 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Volume 294d8a4b-a243-470f-8d4b-7ef97c038fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5', 'volume_size': 1} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1999805805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294d8a4b-a243-470f-8d4b-7ef97c038fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19d59b5859c49418b7857b877b2ae0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:28Z,use_quota=True,user_id='30157f6ab5b0423e893bfba3cc012352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Creating volume 294d8a4b-a243-470f-8d4b-7ef97c038fd5 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:01:28 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:01:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:28 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5 1073741824 Jul 18 06:01:28 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:29 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5 1073741824" returned: 0 in 0.891s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:29 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5 Jul 18 06:01:29 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:29 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5" returned: 0 in 0.382s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:01:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb34636-621b-4e95-898a-cc27e542bdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69c6f8a-c644-4fc7-9140-7f6554410cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:29 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Volume volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5 (294d8a4b-a243-470f-8d4b-7ef97c038fd5): created successfully Jul 18 06:01:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c69c6f8a-c644-4fc7-9140-7f6554410cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Flow 'volume_create_manager' (2871a96b-bce4-45ea-985b-854fd0ca885d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1f686faa-0c0b-46a4-9bfd-7ead7fd2778a tempest-ServersNegativeTestJSON-1156818397 None] Created volume successfully. Jul 18 06:01:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Acquiring lock "cinder-294d8a4b-a243-470f-8d4b-7ef97c038fd5-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:01:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Lock "cinder-294d8a4b-a243-470f-8d4b-7ef97c038fd5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:01:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Acquiring lock "cinder-quobyte-294d8a4b-a243-470f-8d4b-7ef97c038fd5" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:01:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Lock "cinder-quobyte-294d8a4b-a243-470f-8d4b-7ef97c038fd5" acquired by "delete_volume" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:01:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[557dc322-4aee-4ef5-9ffe-e5b16b114cf4]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:01:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:31 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5 Jul 18 06:01:31 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:31 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5" returned: 0 in 0.418s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:31 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5 Jul 18 06:01:31 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:32 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-294d8a4b-a243-470f-8d4b-7ef97c038fd5" returned: 0 in 0.361s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Lock "cinder-quobyte-294d8a4b-a243-470f-8d4b-7ef97c038fd5" released by "delete_volume" :: held 0.837s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Created reservations ['b0175b21-55eb-4024-9e90-62b98645b416', 'c9f0e11f-b379-44b8-b827-3801eb9a6bb6', '0a495a83-c15e-466c-98c0-47ec1bef9ede', '86885b1c-b8a3-4727-ab27-4398217dc94e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:32 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:01:32 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Acquiring lock "cinder-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Lock "cinder-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Acquiring lock "cinder-quobyte-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Lock "cinder-quobyte-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea704879-1947-418a-8b11-b0254f68c1ed]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:32 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365 Jul 18 06:01:32 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:32 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.592s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:01:32 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Deleted volume successfully. Jul 18 06:01:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cb26ffe9-929c-46ff-ac47-39fae17b8412 tempest-ServersNegativeTestJSON-1156818397 None] Lock "cinder-294d8a4b-a243-470f-8d4b-7ef97c038fd5-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:01:33 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365" returned: 0 in 0.567s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:33 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365 Jul 18 06:01:33 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (0347a1cf-2ca1-4452-8790-7555c292435d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32b9276-a88a-496f-a514-f153697f98d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:33 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365" returned: 0 in 0.347s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32b9276-a88a-496f-a514-f153697f98d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1914256515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c688e5-723a-4603-8e52-e8b61dac10dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:33Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfd9833-69c9-45c3-84f6-874455e91776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfd9833-69c9-45c3-84f6-874455e91776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed074f7-f47b-4756-b439-04ddbfa4745a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed074f7-f47b-4756-b439-04ddbfa4745a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c688e5-723a-4603-8e52-e8b61dac10dc', 'volume_name': 'volume-57c688e5-723a-4603-8e52-e8b61dac10dc', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c155d47e-bb76-49ab-9af0-c0b9bf8dfffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c155d47e-bb76-49ab-9af0-c0b9bf8dfffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2231340-e5d5-4454-abde-00b1c6a5484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:33 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Volume 57c688e5-723a-4603-8e52-e8b61dac10dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c688e5-723a-4603-8e52-e8b61dac10dc', 'volume_size': 1} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1914256515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c688e5-723a-4603-8e52-e8b61dac10dc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:33Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Creating volume 57c688e5-723a-4603-8e52-e8b61dac10dc {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:01:33 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c688e5-723a-4603-8e52-e8b61dac10dc 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Lock "cinder-quobyte-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365" released by "delete_volume" :: held 1.051s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:01:33 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c688e5-723a-4603-8e52-e8b61dac10dc 1073741824 Jul 18 06:01:33 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Created reservations ['dca9fc1f-1331-4efa-9cb4-c48f818996d5', '8aff029b-47ce-4eca-b814-5bd4700bf5e3', '7ff40072-0850-4596-8c85-511cc274ebf6', 'b0773446-cb11-4476-aeed-d1fbeaad3140'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:33 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:01:33 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:34 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:34 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:01:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Deleted volume successfully. Jul 18 06:01:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3321e2ca-63c5-4b74-aafb-bc04d3a81a51 tempest-ServersNegativeTestJSON-1156818397 None] Lock "cinder-5a9b9230-d2ed-46c4-b9e7-fdb2470a2365-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:01:34 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c688e5-723a-4603-8e52-e8b61dac10dc 1073741824" returned: 0 in 0.560s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c688e5-723a-4603-8e52-e8b61dac10dc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:34 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c688e5-723a-4603-8e52-e8b61dac10dc Jul 18 06:01:34 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:34 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c688e5-723a-4603-8e52-e8b61dac10dc" returned: 0 in 0.257s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:01:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2231340-e5d5-4454-abde-00b1c6a5484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c688e5-723a-4603-8e52-e8b61dac10dc', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2b1942-c25e-43f2-8bfa-232e5e8e5878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Volume volume-57c688e5-723a-4603-8e52-e8b61dac10dc (57c688e5-723a-4603-8e52-e8b61dac10dc): created successfully Jul 18 06:01:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2b1942-c25e-43f2-8bfa-232e5e8e5878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (0347a1cf-2ca1-4452-8790-7555c292435d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-eeeea16c-5281-4e2f-ba10-e9b03f04b431 tempest-VolumesGetTest-1891977562 None] Created volume successfully. Jul 18 06:01:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:01:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:35 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:01:35 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:35 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.327s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:01:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:01:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 8 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:01:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (5f8bb51b-dffa-4e5e-bfb5-6f40fea153ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bdb5d7-60ce-4bd6-a380-84f95749126a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04bdb5d7-60ce-4bd6-a380-84f95749126a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-406478363',display_name='tempest-VolumesGetTest-Volume-426928583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7725dc-2eb0-44b0-b585-420884afa117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:37Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8550e107-d259-4454-9b1f-9275c706b478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8550e107-d259-4454-9b1f-9275c706b478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedd0794-9d88-4001-9e19-3a752efc93b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedd0794-9d88-4001-9e19-3a752efc93b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7725dc-2eb0-44b0-b585-420884afa117', 'volume_name': 'volume-6d7725dc-2eb0-44b0-b585-420884afa117', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdd7651-a575-4f55-9a93-b07b34dbfbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bdd7651-a575-4f55-9a93-b07b34dbfbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa5b3d3-1b70-4223-b1b8-b977f55a1d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:37 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Volume 6d7725dc-2eb0-44b0-b585-420884afa117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7725dc-2eb0-44b0-b585-420884afa117', 'volume_size': 1} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-406478363',display_name='tempest-VolumesGetTest-Volume-426928583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7725dc-2eb0-44b0-b585-420884afa117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:37Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Creating volume 6d7725dc-2eb0-44b0-b585-420884afa117 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:01:37 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:01:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d7725dc-2eb0-44b0-b585-420884afa117 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:37 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d7725dc-2eb0-44b0-b585-420884afa117 1073741824 Jul 18 06:01:37 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:38 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d7725dc-2eb0-44b0-b585-420884afa117 1073741824" returned: 0 in 0.632s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d7725dc-2eb0-44b0-b585-420884afa117 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:38 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d7725dc-2eb0-44b0-b585-420884afa117 Jul 18 06:01:38 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:38 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d7725dc-2eb0-44b0-b585-420884afa117" returned: 0 in 0.269s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:01:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa5b3d3-1b70-4223-b1b8-b977f55a1d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7725dc-2eb0-44b0-b585-420884afa117', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98280ae8-dfc9-4046-a624-cedb02d353bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Volume volume-6d7725dc-2eb0-44b0-b585-420884afa117 (6d7725dc-2eb0-44b0-b585-420884afa117): created successfully Jul 18 06:01:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98280ae8-dfc9-4046-a624-cedb02d353bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (5f8bb51b-dffa-4e5e-bfb5-6f40fea153ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b623e702-26e4-4dbc-96e0-0a992c77a556 tempest-VolumesGetTest-1891977562 None] Created volume successfully. Jul 18 06:01:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-6d7725dc-2eb0-44b0-b585-420884afa117-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:01:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Lock "cinder-6d7725dc-2eb0-44b0-b585-420884afa117-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:01:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-quobyte-6d7725dc-2eb0-44b0-b585-420884afa117" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:01:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-6d7725dc-2eb0-44b0-b585-420884afa117" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:01:39 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8a8e1d-4327-453d-a6e5-daff72840b34]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:01:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d7725dc-2eb0-44b0-b585-420884afa117 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:40 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d7725dc-2eb0-44b0-b585-420884afa117 Jul 18 06:01:40 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:40 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d7725dc-2eb0-44b0-b585-420884afa117" returned: 0 in 0.371s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d7725dc-2eb0-44b0-b585-420884afa117 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:40 devstack sudo[93670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d7725dc-2eb0-44b0-b585-420884afa117 Jul 18 06:01:40 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:40 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d7725dc-2eb0-44b0-b585-420884afa117" returned: 0 in 0.282s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-6d7725dc-2eb0-44b0-b585-420884afa117" released by "delete_volume" :: held 0.694s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:01:40 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Created reservations ['4ad49eb2-3e69-4524-93b5-b371ed96a81f', '4544acfa-f7ce-4a73-a399-b2a34edad42f', '2e2c3198-c8cf-4afb-ba52-c3290c4d7130', '09c291f2-566b-4b51-91f0-2831f9be1edd'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:01:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:40 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:01:40 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-57c688e5-723a-4603-8e52-e8b61dac10dc-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:01:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Lock "cinder-57c688e5-723a-4603-8e52-e8b61dac10dc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:01:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-quobyte-57c688e5-723a-4603-8e52-e8b61dac10dc" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:01:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-57c688e5-723a-4603-8e52-e8b61dac10dc" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:01:41 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.373s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:41 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:01:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53d3fb3-e550-4eff-ba1d-0cb80a7cb38a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:01:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c688e5-723a-4603-8e52-e8b61dac10dc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Deleted volume successfully. Jul 18 06:01:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a7637165-51a8-4bb9-b04a-0ff3fe485a24 tempest-VolumesGetTest-1891977562 None] Lock "cinder-6d7725dc-2eb0-44b0-b585-420884afa117-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:01:41 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c688e5-723a-4603-8e52-e8b61dac10dc Jul 18 06:01:41 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:41 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c688e5-723a-4603-8e52-e8b61dac10dc" returned: 0 in 0.566s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c688e5-723a-4603-8e52-e8b61dac10dc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:41 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c688e5-723a-4603-8e52-e8b61dac10dc Jul 18 06:01:41 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:42 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c688e5-723a-4603-8e52-e8b61dac10dc" returned: 0 in 0.269s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-57c688e5-723a-4603-8e52-e8b61dac10dc" released by "delete_volume" :: held 0.921s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:01:42 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Created reservations ['6ce25fce-10ca-4ffd-ab3e-cf012d265a97', '5f3ff646-353e-4ad2-8fe5-e969ef41d11e', 'e4fb03ed-ed69-4e6a-b8b8-20d0c5264c0a', '7e0b47c5-4815-43d5-8b00-cba096adaf7f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:01:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:42 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:01:42 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:42 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:42 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:01:42 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Deleted volume successfully. Jul 18 06:01:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-22ed3dd9-efc7-437b-ba36-6e7a2216c98f tempest-VolumesGetTest-1891977562 None] Lock "cinder-57c688e5-723a-4603-8e52-e8b61dac10dc-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (2659e44b-fa2c-482d-9526-1086bd13588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37ff696-b83a-499d-8551-f2be6450de1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37ff696-b83a-499d-8551-f2be6450de1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-502506561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af39d7f-95c4-48d7-90e7-b298c28c0942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:44Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84689ec1-54cc-4b0e-a96c-5dcca38f3bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84689ec1-54cc-4b0e-a96c-5dcca38f3bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0024b95-a287-4734-8edc-b6876817238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0024b95-a287-4734-8edc-b6876817238e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af39d7f-95c4-48d7-90e7-b298c28c0942', 'volume_name': 'volume-9af39d7f-95c4-48d7-90e7-b298c28c0942', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2a6525-bdeb-400e-bd64-b070e492d685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a2a6525-bdeb-400e-bd64-b070e492d685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a02bad2-d010-4c32-8540-d75bddc5edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Volume 9af39d7f-95c4-48d7-90e7-b298c28c0942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af39d7f-95c4-48d7-90e7-b298c28c0942', 'volume_size': 1} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-502506561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af39d7f-95c4-48d7-90e7-b298c28c0942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:44Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Creating volume 9af39d7f-95c4-48d7-90e7-b298c28c0942 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:01:43 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:01:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:43 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 1073741824 Jul 18 06:01:43 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:44 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 1073741824" returned: 0 in 0.449s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:44 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 Jul 18 06:01:44 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:44 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942" returned: 0 in 0.276s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:01:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a02bad2-d010-4c32-8540-d75bddc5edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af39d7f-95c4-48d7-90e7-b298c28c0942', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d7728d-82ff-407f-b566-4c711311fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:44 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Volume volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 (9af39d7f-95c4-48d7-90e7-b298c28c0942): created successfully Jul 18 06:01:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d7728d-82ff-407f-b566-4c711311fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (2659e44b-fa2c-482d-9526-1086bd13588c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-66cceeab-7716-4baf-a75f-e9d88316e158 tempest-VolumesGetTest-1891977562 None] Created volume successfully. Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (a94dbaf3-bdc8-4d35-8b12-2bf0ed585ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2a781e-97d8-4e62-aaa1-d40e021ac206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2a781e-97d8-4e62-aaa1-d40e021ac206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-88214274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a96bb4-0f13-4b63-ab53-0ed041d833bf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9af39d7f-95c4-48d7-90e7-b298c28c0942,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:46Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f49993-0667-45da-ad8c-de723a0329ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f49993-0667-45da-ad8c-de723a0329ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a06d62c-3eab-4f71-92f2-596c5f0b8ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a06d62c-3eab-4f71-92f2-596c5f0b8ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a1a96bb4-0f13-4b63-ab53-0ed041d833bf', 'volume_name': 'volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf', 'volume_size': 1, 'source_volid': '9af39d7f-95c4-48d7-90e7-b298c28c0942', 'source_volstatus': 'available'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6d94b9-c352-476f-9571-523e7efa1052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6d94b9-c352-476f-9571-523e7efa1052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed6062d-366d-4354-a181-d4255f514b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:46 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Volume a1a96bb4-0f13-4b63-ab53-0ed041d833bf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf', 'volume_size': 1, 'source_volid': '9af39d7f-95c4-48d7-90e7-b298c28c0942', 'source_volstatus': 'available'} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:46 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Cloning volume 9af39d7f-95c4-48d7-90e7-b298c28c0942 to volume a1a96bb4-0f13-4b63-ab53-0ed041d833bf Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Creating offline snapshot b57224c6-d0d3-454b-8951-90de623ad55b of volume 9af39d7f-95c4-48d7-90e7-b298c28c0942 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01d3a3f-4b0f-4700-b719-81d01b3d3fed]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:01:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:46 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 Jul 18 06:01:46 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-3a44f950-09bc-4d6d-957c-2e38b10b8f94 req-fdddd1d0-db11-4bb6-ae0b-02a8b8f09ade tempest-AttachVolumeTestJSON-231829717 None] Terminate volume connection completed successfully. Jul 18 06:01:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3a44f950-09bc-4d6d-957c-2e38b10b8f94 req-fdddd1d0-db11-4bb6-ae0b-02a8b8f09ade tempest-AttachVolumeTestJSON-231829717 None] Deleting attachment 2ffb1f17-b702-4d70-b31d-282d2dc90680. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:01:47 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942" returned: 0 in 0.515s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:47 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b 1G Jul 18 06:01:47 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:47 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b 1G" returned: 0 in 0.586s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:47 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b Jul 18 06:01:47 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:48 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:48 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b is being set with open permissions: ugo+rw Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:48 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b Jul 18 06:01:48 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:48 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b" returned: 0 in 0.357s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:48 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.info Jul 18 06:01:48 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Flow 'volume_create_manager' (e02bd7ac-a054-464e-bedc-461ef5fc9510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59292a40-dfae-46f1-8488-0bbaff97c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59292a40-dfae-46f1-8488-0bbaff97c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1274320710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d751c30-a778-425e-91be-15def167f2fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1c9a686b5d548af99b5603499fb7b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:49Z,use_quota=True,user_id='49402e0e704a4a28b6ec88a039e9949a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b9cc66-dcb5-48c4-b75d-a28df7686e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b9cc66-dcb5-48c4-b75d-a28df7686e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d95a8f-33f9-444c-ab3a-7c52f89db87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d95a8f-33f9-444c-ab3a-7c52f89db87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d751c30-a778-425e-91be-15def167f2fb', 'volume_name': 'volume-4d751c30-a778-425e-91be-15def167f2fb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda52f06-856d-402e-8906-abcd6c55037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda52f06-856d-402e-8906-abcd6c55037b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309f9d53-a7f2-4405-82e8-e1ec4d7bb19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:01:48 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Volume 4d751c30-a778-425e-91be-15def167f2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d751c30-a778-425e-91be-15def167f2fb', 'volume_size': 1} Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:48 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.info" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:48 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.info is being set with open permissions: ugo+rw Jul 18 06:01:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:48 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.info Jul 18 06:01:49 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:49 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.info" returned: 0 in 0.252s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-quobyte-a1a96bb4-0f13-4b63-ab53-0ed041d833bf" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-a1a96bb4-0f13-4b63-ab53-0ed041d833bf" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] snapshot: b57224c6-d0d3-454b-8951-90de623ad55b, volume: a1a96bb4-0f13-4b63-ab53-0ed041d833bf, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc025c5f-9ec8-4349-916c-c1821a381d25]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:49 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b Jul 18 06:01:49 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:49 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b" returned: 0 in 0.362s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af39d7f-95c4-48d7-90e7-b298c28c0942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e882bc-e574-4a6c-9f19-d21c18d19227]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:01:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:49 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 Jul 18 06:01:49 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:50 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942" returned: 0 in 0.407s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:50 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Path /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 06:01:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:50 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf Jul 18 06:01:50 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:57 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf" returned: 0 in 7.842s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0973269d-7e10-4ed1-b14d-5f282129cb0b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:01:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:58 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 Jul 18 06:01:58 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:58 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942" returned: 0 in 0.594s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942, size 1024.00 MB, duration 7.84 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:01:58 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Converted 1024.00 MB image at 130.56 MB/s Jul 18 06:01:58 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf is being set with open permissions: ugo+rw Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:58 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf Jul 18 06:01:58 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=52,cinder:UPDATE=67,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=53,cinder:UPDATE=61,cinder:INSERT=16,cinder:DELETE=9 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:01:58 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-a1a96bb4-0f13-4b63-ab53-0ed041d833bf" released by "_copy_volume_from_snapshot" :: held 9.548s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-quobyte-b57224c6-d0d3-454b-8951-90de623ad55b" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-b57224c6-d0d3-454b-8951-90de623ad55b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Deleting offline snapshot b57224c6-d0d3-454b-8951-90de623ad55b of volume 9af39d7f-95c4-48d7-90e7-b298c28c0942 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] snapshot_file for this snap is: volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b5dd73-e77c-432c-9fcd-3b1532a2d781]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:01:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:58 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b Jul 18 06:01:58 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:59 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b" returned: 0 in 0.366s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af39d7f-95c4-48d7-90e7-b298c28c0942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:01:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c0d851-6b49-4903-92d5-dd8e16473eb2]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:01:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:59 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 Jul 18 06:01:59 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:01:59 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Jul 18 06:01:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942" returned: 0 in 0.425s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:01:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:01:59 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b Jul 18 06:01:59 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:00 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b" returned: 0 in 0.362s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:00 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b Jul 18 06:02:00 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Acquiring lock "cinder-f8fdfb3f-df2f-4933-8b6d-15a592265519-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Lock "cinder-f8fdfb3f-df2f-4933-8b6d-15a592265519-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Acquiring lock "cinder-quobyte-f8fdfb3f-df2f-4933-8b6d-15a592265519" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:00 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942.b57224c6-d0d3-454b-8951-90de623ad55b" returned: 0 in 0.356s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-b57224c6-d0d3-454b-8951-90de623ad55b" released by "_delete_snapshot" :: held 1.615s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Lock "cinder-quobyte-f8fdfb3f-df2f-4933-8b6d-15a592265519" acquired by "delete_volume" :: waited 0.040s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b725e5-212b-4b25-9cc3-025291008f88]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f8fdfb3f-df2f-4933-8b6d-15a592265519 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.832s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.690s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1274320710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d751c30-a778-425e-91be-15def167f2fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1c9a686b5d548af99b5603499fb7b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:01:49Z,use_quota=True,user_id='49402e0e704a4a28b6ec88a039e9949a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Creating volume 4d751c30-a778-425e-91be-15def167f2fb {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:02:00 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4d751c30-a778-425e-91be-15def167f2fb 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed6062d-366d-4354-a181-d4255f514b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf', 'volume_size': 1, 'source_volid': '9af39d7f-95c4-48d7-90e7-b298c28c0942', 'source_volstatus': 'available'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272b0da9-282c-4db2-8d18-658dc014cbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:00 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4d751c30-a778-425e-91be-15def167f2fb 1073741824 Jul 18 06:02:00 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:00 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Volume volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf (a1a96bb4-0f13-4b63-ab53-0ed041d833bf): created successfully Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272b0da9-282c-4db2-8d18-658dc014cbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (a94dbaf3-bdc8-4d35-8b12-2bf0ed585ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:00 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f8fdfb3f-df2f-4933-8b6d-15a592265519 Jul 18 06:02:00 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4337dd6d-d7a5-4f0d-b46a-1c949b5fb185 tempest-VolumesGetTest-1891977562 None] Created volume successfully. Jul 18 06:02:00 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f8fdfb3f-df2f-4933-8b6d-15a592265519" returned: 0 in 0.409s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f8fdfb3f-df2f-4933-8b6d-15a592265519 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:00 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f8fdfb3f-df2f-4933-8b6d-15a592265519 Jul 18 06:02:00 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:01 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4d751c30-a778-425e-91be-15def167f2fb 1073741824" returned: 0 in 0.539s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4d751c30-a778-425e-91be-15def167f2fb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:01 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4d751c30-a778-425e-91be-15def167f2fb Jul 18 06:02:01 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:01 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f8fdfb3f-df2f-4933-8b6d-15a592265519" returned: 0 in 0.278s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Lock "cinder-quobyte-f8fdfb3f-df2f-4933-8b6d-15a592265519" released by "delete_volume" :: held 0.742s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Created reservations ['8d100cd9-e865-44fe-b7fc-cb5a8deab1c3', 'e75a995c-e506-460e-9204-4adaec48b82a', '383628f4-5aeb-41c0-9d7e-ffa4837b64c1', '74d540cb-c7c8-4627-a698-7a3dde23d8bf'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:01 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:02:01 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:01 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4d751c30-a778-425e-91be-15def167f2fb" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309f9d53-a7f2-4405-82e8-e1ec4d7bb19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d751c30-a778-425e-91be-15def167f2fb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a19e4c2-2d90-4f0a-9157-fbc5176699f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:01 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Volume volume-4d751c30-a778-425e-91be-15def167f2fb (4d751c30-a778-425e-91be-15def167f2fb): created successfully Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a19e4c2-2d90-4f0a-9157-fbc5176699f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Flow 'volume_create_manager' (e02bd7ac-a054-464e-bedc-461ef5fc9510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-bce6feb1-1dfd-44b4-86f2-70722bf0de08 req-05f5e78c-ac32-4efb-a642-51fd22fa7ab6 tempest-VolumesGetTestJSON-1108772237 None] Created volume successfully. Jul 18 06:02:01 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:02:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Deleted volume successfully. Jul 18 06:02:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d94e518b-af03-4cd0-9389-591d43cbfb1a tempest-AttachVolumeShelveTestJSON-1145163087 None] Lock "cinder-f8fdfb3f-df2f-4933-8b6d-15a592265519-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Acquiring lock "cinder-4d751c30-a778-425e-91be-15def167f2fb-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Lock "cinder-4d751c30-a778-425e-91be-15def167f2fb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Acquiring lock "cinder-quobyte-4d751c30-a778-425e-91be-15def167f2fb" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Lock "cinder-quobyte-4d751c30-a778-425e-91be-15def167f2fb" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc82cdd-a2ee-416a-a515-53d980a76607]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4d751c30-a778-425e-91be-15def167f2fb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:02 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4d751c30-a778-425e-91be-15def167f2fb Jul 18 06:02:02 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (64f36b42-7f64-4c43-93f3-e99a8cd8f481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390b45b1-88d4-4876-abb1-2e63736d6f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:02 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390b45b1-88d4-4876-abb1-2e63736d6f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:02:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1854633030',display_name='tempest-VolumesGetTest-Volume-1805716529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea76848-962a-49fe-b8d8-1d1a8b7b5e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:03Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfaabce4-8584-466f-9254-3f0dcde0e307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfaabce4-8584-466f-9254-3f0dcde0e307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11d06d0-2a41-449b-8140-e154a2e0c369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11d06d0-2a41-449b-8140-e154a2e0c369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea76848-962a-49fe-b8d8-1d1a8b7b5e00', 'volume_name': 'volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d788a98-291c-4e28-9fa8-36360a646e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d788a98-291c-4e28-9fa8-36360a646e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8405c0b9-8909-473f-ba05-9e7e11b0c342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:02 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Volume 9ea76848-962a-49fe-b8d8-1d1a8b7b5e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00', 'volume_size': 1} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:02:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1854633030',display_name='tempest-VolumesGetTest-Volume-1805716529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea76848-962a-49fe-b8d8-1d1a8b7b5e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:03Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Creating volume 9ea76848-962a-49fe-b8d8-1d1a8b7b5e00 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:02:02 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4d751c30-a778-425e-91be-15def167f2fb" returned: 0 in 0.599s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4d751c30-a778-425e-91be-15def167f2fb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:02 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00 1073741824 Jul 18 06:02:02 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:02 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4d751c30-a778-425e-91be-15def167f2fb Jul 18 06:02:02 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:03 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4d751c30-a778-425e-91be-15def167f2fb" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Lock "cinder-quobyte-4d751c30-a778-425e-91be-15def167f2fb" released by "delete_volume" :: held 0.957s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG cinder.quota [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Created reservations ['3df6b6e6-0847-45e7-8037-1098be904d8b', 'dba7e13a-c28f-46d7-ba4b-2e4cbae48afc', '7e7956b6-60ab-4846-ab9c-e5561f264b5e', '2a4ae18e-82c0-4692-987d-41d8f2d61ab9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:03 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:02:03 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:03 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00 1073741824" returned: 0 in 0.600s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:03 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00 Jul 18 06:02:03 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:03 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.486s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG cinder.manager [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:02:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Deleted volume successfully. Jul 18 06:02:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-a987a899-d656-456c-a445-5cf4d74d2174 req-3ea04de0-5e43-4ed2-934f-13835e4aaab5 tempest-VolumesGetTestJSON-1108772237 None] Lock "cinder-4d751c30-a778-425e-91be-15def167f2fb-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:04 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00" returned: 0 in 0.480s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:02:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8405c0b9-8909-473f-ba05-9e7e11b0c342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02f83b7-9f31-4a4f-b370-1b689cb152eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Volume volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00 (9ea76848-962a-49fe-b8d8-1d1a8b7b5e00): created successfully Jul 18 06:02:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02f83b7-9f31-4a4f-b370-1b689cb152eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (64f36b42-7f64-4c43-93f3-e99a8cd8f481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-882e7fbe-c655-482a-9314-71cbdd8777ab tempest-VolumesGetTest-1891977562 None] Created volume successfully. Jul 18 06:02:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Lock "cinder-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-quobyte-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00" acquired by "delete_volume" :: waited 0.063s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff09189-5ad2-4f25-8b70-7b3bed339430]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:05 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00 Jul 18 06:02:05 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:05 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00" returned: 0 in 0.537s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:05 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00 Jul 18 06:02:05 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:06 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00" returned: 0 in 0.305s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00" released by "delete_volume" :: held 0.927s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:06 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Created reservations ['0df70acb-bba4-4a1f-abd8-773a75181a91', '1f8f4445-10ed-4854-9f21-1e81d9bd9da1', 'e667395e-fcd2-4b7b-a904-40e2a9843ded', 'd7c7484d-3765-436b-b8e7-cc2cab7544e5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:02:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:06 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:02:06 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:06 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.435s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:06 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:02:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Deleted volume successfully. Jul 18 06:02:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-709469fa-56b2-4231-89ce-48b92e0f8ba6 tempest-VolumesGetTest-1891977562 None] Lock "cinder-9ea76848-962a-49fe-b8d8-1d1a8b7b5e00-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-a1a96bb4-0f13-4b63-ab53-0ed041d833bf-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Lock "cinder-a1a96bb4-0f13-4b63-ab53-0ed041d833bf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-quobyte-a1a96bb4-0f13-4b63-ab53-0ed041d833bf" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-a1a96bb4-0f13-4b63-ab53-0ed041d833bf" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b736fc-b2a8-46c4-b298-d9d317b3a2a8]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:07 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf Jul 18 06:02:07 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:08 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf" returned: 0 in 0.447s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:08 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf Jul 18 06:02:08 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:08 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a1a96bb4-0f13-4b63-ab53-0ed041d833bf" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-a1a96bb4-0f13-4b63-ab53-0ed041d833bf" released by "delete_volume" :: held 0.769s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Created reservations ['b2c782c0-4164-4d90-8f28-2a92e34831c1', 'aef8ccb2-af8b-4a62-ae0a-1c1b40f3177c', 'ce732441-06c7-4cb6-ac46-15cb60da0788', '4d909082-0d35-4a03-8dd0-fd656ab5f1a5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:08 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:02:08 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-9af39d7f-95c4-48d7-90e7-b298c28c0942-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Lock "cinder-9af39d7f-95c4-48d7-90e7-b298c28c0942-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-quobyte-9af39d7f-95c4-48d7-90e7-b298c28c0942" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-9af39d7f-95c4-48d7-90e7-b298c28c0942" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9a0fa8-6723-4cab-b0ef-71865f078650]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:09 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.423s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:02:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Deleted volume successfully. Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9ab1653d-97e3-4556-ba29-82730f42c0a6 tempest-VolumesGetTest-1891977562 None] Lock "cinder-a1a96bb4-0f13-4b63-ab53-0ed041d833bf-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:09 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 Jul 18 06:02:09 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:09 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942" returned: 0 in 0.416s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:09 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942 Jul 18 06:02:09 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a645c2ba-2485-4e93-9b55-9a9fdeb99747 tempest-GroupSnapshotsTest-473363618 None] Group tempest-GroupSnapshotsTest-Group-331678130: creating Jul 18 06:02:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a645c2ba-2485-4e93-9b55-9a9fdeb99747 tempest-GroupSnapshotsTest-473363618 None] Group tempest-GroupSnapshotsTest-Group-331678130: created successfully Jul 18 06:02:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a645c2ba-2485-4e93-9b55-9a9fdeb99747 tempest-GroupSnapshotsTest-473363618 None] Create group completed successfully. Jul 18 06:02:09 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9af39d7f-95c4-48d7-90e7-b298c28c0942" returned: 0 in 0.337s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-9af39d7f-95c4-48d7-90e7-b298c28c0942" released by "delete_volume" :: held 0.825s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Created reservations ['8a8470fa-edac-4671-b0f1-021f20b5c9e8', 'f2cbb68f-2431-4b67-885c-da90c0252029', 'e7ac334f-0025-4a24-a5cf-1b04aef11f5a', 'ce553fa1-05e1-450c-b50d-e7afa415517e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:10 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:02:10 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:10 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.298s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:10 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:02:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Deleted volume successfully. Jul 18 06:02:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-02cff5a4-122f-4e87-8087-eb3acd8de670 tempest-VolumesGetTest-1891977562 None] Lock "cinder-9af39d7f-95c4-48d7-90e7-b298c28c0942-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (26e4b1ec-485d-41f5-a43f-544ff8ee79b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4009381f-2b9d-4e01-a859-e93d0e858fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4009381f-2b9d-4e01-a859-e93d0e858fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-18597083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9271282b-8f0a-47ec-959a-f1ff06c4e217,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:12Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6795910-5d3a-4944-9a0f-dc25cb7afc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6795910-5d3a-4944-9a0f-dc25cb7afc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcf9711-a1b9-452f-a4c1-e005eb25fdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Flow 'volume_create_manager' (1afa1c47-37dc-42d5-94e5-5820a9c2dd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f09e1dc-b392-4aa7-8a5e-7b55dfbde595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f09e1dc-b392-4aa7-8a5e-7b55dfbde595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1334448020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e76a5fa-f56f-476c-ba70-9209f52a5fc1,host='devstack@QuobyteHD#QuobyteHD',id=bf5e86f1-1f75-4e4d-986d-944d5097d83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13999ad858fd4cbe8524f040b3582477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:12Z,use_quota=True,user_id='92364ca2f8fc441eb3015f960f312c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c721d300-9903-4942-b7c3-142e37a445ed),volume_type_id=c721d300-9903-4942-b7c3-142e37a445ed)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f57ff6-98e1-4592-ac79-d1a9c8c41a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f57ff6-98e1-4592-ac79-d1a9c8c41a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fca250-1447-410b-a77e-bc4a9627a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fca250-1447-410b-a77e-bc4a9627a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf5e86f1-1f75-4e4d-986d-944d5097d83d', 'volume_name': 'volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a752be9-63d0-46b4-a380-bca4c9ef91ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a752be9-63d0-46b4-a380-bca4c9ef91ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4cd3642-be7c-44bd-a743-311fd507fcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:11 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Volume bf5e86f1-1f75-4e4d-986d-944d5097d83d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d', 'volume_size': 1} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e76a5fa-f56f-476c-ba70-9209f52a5fc1,created_at=2026-07-18T04:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1334448020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e76a5fa-f56f-476c-ba70-9209f52a5fc1,host='devstack@QuobyteHD#QuobyteHD',id=bf5e86f1-1f75-4e4d-986d-944d5097d83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13999ad858fd4cbe8524f040b3582477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:12Z,use_quota=True,user_id='92364ca2f8fc441eb3015f960f312c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c721d300-9903-4942-b7c3-142e37a445ed),volume_type_id=c721d300-9903-4942-b7c3-142e37a445ed)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Creating volume bf5e86f1-1f75-4e4d-986d-944d5097d83d {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:02:11 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:02:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:11 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d 1073741824 Jul 18 06:02:11 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcf9711-a1b9-452f-a4c1-e005eb25fdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9271282b-8f0a-47ec-959a-f1ff06c4e217', 'volume_name': 'volume-9271282b-8f0a-47ec-959a-f1ff06c4e217', 'volume_size': 1, 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56cf243eadf74e53add363d5f7382182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'created_at': datetime.datetime(2026, 7, 18, 3, 51, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 51, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca90a05-bbc2-4b0e-a241-c81f8269d864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca90a05-bbc2-4b0e-a241-c81f8269d864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fda95be-7aa2-4694-a062-b86ff6888eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Volume 9271282b-8f0a-47ec-959a-f1ff06c4e217: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9271282b-8f0a-47ec-959a-f1ff06c4e217', 'volume_size': 1, 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56cf243eadf74e53add363d5f7382182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'created_at': datetime.datetime(2026, 7, 18, 3, 51, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 51, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Trying to clone 9271282b-8f0a-47ec-959a-f1ff06c4e217 from image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 06:02:12 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d 1073741824" returned: 0 in 0.626s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:12 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d Jul 18 06:02:12 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 06:02:12 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Image download 20.69 MB at 20.69 MB/s Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf03a6b-cc52-4e2f-9da4-19854146c884]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:12 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD Jul 18 06:02:12 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:12 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4cd3642-be7c-44bd-a743-311fd507fcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba304a95-9593-4e52-be53-d5fd24458973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Volume volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d (bf5e86f1-1f75-4e4d-986d-944d5097d83d): created successfully Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba304a95-9593-4e52-be53-d5fd24458973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Flow 'volume_create_manager' (1afa1c47-37dc-42d5-94e5-5820a9c2dd44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e7e606f2-285b-452a-92ce-3c18cd88d4c2 tempest-GroupSnapshotsTest-473363618 None] Created volume successfully. Jul 18 06:02:13 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Temporary image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a is fetched for user abb0ec69ea974da1a5242ee95980a3dc. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbfdffb-4aa6-463f-93b9-fd05019843b4]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:13 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD Jul 18 06:02:13 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:13 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-18597083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9271282b-8f0a-47ec-959a-f1ff06c4e217,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:12Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Creating volume 9271282b-8f0a-47ec-959a-f1ff06c4e217 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:02:13 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:13 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 1073741824 Jul 18 06:02:13 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:13 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 1073741824" returned: 0 in 0.451s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:13 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 Jul 18 06:02:13 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] GroupSnapshot ab10d3c7-b532-4a27-979d-147b3cc87ae8: creating. Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] Group snapshot ab10d3c7-b532-4a27-979d-147b3cc87ae8: creating. {{(pid=87750) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:14 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217" returned: 0 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.068s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] Creating offline snapshot 51ca11dd-b7c1-48bf-87a4-1615b111dd6a of volume bf5e86f1-1f75-4e4d-986d-944d5097d83d {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Attempting download of b5dcfdae-2c52-436e-9a7d-1ba63c90db8a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}])) to volume 9271282b-8f0a-47ec-959a-f1ff06c4e217. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7455d83a-e719-4add-86c8-5fcbdb85bf5e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cade75-db74-4b71-9114-fa619078be6c]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_ch39yo_e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:14 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d Jul 18 06:02:14 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:14 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_ch39yo_e Jul 18 06:02:14 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:14 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d" returned: 0 in 0.618s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:14 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a 1G Jul 18 06:02:14 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:15 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_ch39yo_e" returned: 0 in 0.573s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_ch39yo_e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:15 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_ch39yo_e Jul 18 06:02:15 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:15 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_ch39yo_e" returned: 1 in 0.457s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_ch39yo_e' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad08dfe-c8ce-414f-a564-2a1415cfe0a8]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:15 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a 1G" returned: 0 in 0.658s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:15 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a Jul 18 06:02:15 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:15 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD Jul 18 06:02:15 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:15 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] b5dcfdae-2c52-436e-9a7d-1ba63c90db8a was qcow2, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:15 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a" returned: 0 in 0.349s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:15 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:02:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:15 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 Jul 18 06:02:15 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:15 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a Jul 18 06:02:15 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:16 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a" returned: 0 in 0.260s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:16 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.info Jul 18 06:02:16 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:16 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.info" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:16 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:02:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:16 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.info Jul 18 06:02:16 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:16 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.info" returned: 0 in 0.331s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2d70abe1-be25-44de-959f-d0bc515aea3a tempest-GroupSnapshotsTest-473363618 None] group_snapshot ab10d3c7-b532-4a27-979d-147b3cc87ae8: created successfully Jul 18 06:02:18 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217" returned: 0 in 2.579s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_1l4rfjbvdevstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:02:18 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Converted 112.00 MB image at 43.41 MB/s Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-51ca11dd-b7c1-48bf-87a4-1615b111dd6a-bf474671-fda0-4d93-9055-a054d5cf58c3" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-51ca11dd-b7c1-48bf-87a4-1615b111dd6a-bf474671-fda0-4d93-9055-a054d5cf58c3" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Creating volume bf474671-fda0-4d93-9055-a054d5cf58c3 from snapshot 51ca11dd-b7c1-48bf-87a4-1615b111dd6a {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:18 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 1G Jul 18 06:02:18 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-bf474671-fda0-4d93-9055-a054d5cf58c3" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-bf474671-fda0-4d93-9055-a054d5cf58c3" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] snapshot: 51ca11dd-b7c1-48bf-87a4-1615b111dd6a, volume: bf474671-fda0-4d93-9055-a054d5cf58c3, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[582c48d8-f822-4d9d-86d5-2be2f4a4024a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:18 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a Jul 18 06:02:18 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:19 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 1G" returned: 0 in 0.508s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Downloaded image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}])) to volume 9271282b-8f0a-47ec-959a-f1ff06c4e217 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Temporary image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a for user abb0ec69ea974da1a5242ee95980a3dc is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Marking volume 9271282b-8f0a-47ec-959a-f1ff06c4e217 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Copying metadata from image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a to 9271282b-8f0a-47ec-959a-f1ff06c4e217. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Creating volume glance metadata for volume 9271282b-8f0a-47ec-959a-f1ff06c4e217 backed by image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fda95be-7aa2-4694-a062-b86ff6888eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9271282b-8f0a-47ec-959a-f1ff06c4e217', 'volume_size': 1, 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56cf243eadf74e53add363d5f7382182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'created_at': datetime.datetime(2026, 7, 18, 3, 51, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 51, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f7bb73-e014-4063-9752-e2463d159533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:19 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Volume volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 (9271282b-8f0a-47ec-959a-f1ff06c4e217): created successfully Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1f7bb73-e014-4063-9752-e2463d159533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (26e4b1ec-485d-41f5-a43f-544ff8ee79b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:19 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a" returned: 0 in 0.652s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 06:02:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1117c1f8-f3c0-4315-b2d6-e14e3b5899d7 tempest-VolumesGetTest-1891977562 None] Created volume successfully. Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e49271e-b464-474a-bda1-56cddc6167aa]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:19 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d Jul 18 06:02:19 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:19 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d" returned: 0 in 0.468s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Path /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 06:02:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:19 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3 Jul 18 06:02:19 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:22 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:02:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (22998f91-2c65-4eed-9c73-498129f8bd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3906bfdf-7886-480b-80bc-8d1d4faeae39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3906bfdf-7886-480b-80bc-8d1d4faeae39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:02:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2138513027',display_name='tempest-VolumesGetTest-Volume-911989233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d5e11c-0a24-438a-90b4-505bd31cb206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:22Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3327111a-9368-4582-92c7-17464399b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3327111a-9368-4582-92c7-17464399b437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9882208b-ac29-46b2-9568-5e323a3bb1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9882208b-ac29-46b2-9568-5e323a3bb1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d5e11c-0a24-438a-90b4-505bd31cb206', 'volume_name': 'volume-a9d5e11c-0a24-438a-90b4-505bd31cb206', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4adee6-79d8-4b36-8668-b81e3735e177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4adee6-79d8-4b36-8668-b81e3735e177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674aa693-70e0-48b1-91c7-838f6925bc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:22 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Volume a9d5e11c-0a24-438a-90b4-505bd31cb206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d5e11c-0a24-438a-90b4-505bd31cb206', 'volume_size': 1} Jul 18 06:02:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:26 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3" returned: 0 in 6.235s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[018452c9-a5a0-4b4c-a0f3-ba0bdd85ca90]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:26 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d Jul 18 06:02:26 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:26 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d" returned: 0 in 0.566s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:02:26 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Converted 1024.00 MB image at 164.17 MB/s Jul 18 06:02:26 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3 is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:26 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3 Jul 18 06:02:26 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:26 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3" returned: 0 in 0.303s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-bf474671-fda0-4d93-9055-a054d5cf58c3" released by "_copy_volume_from_snapshot" :: held 8.377s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-51ca11dd-b7c1-48bf-87a4-1615b111dd6a-bf474671-fda0-4d93-9055-a054d5cf58c3" released by "_create_volume_from_snapshot" :: held 8.427s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.450s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.188s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:02:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2138513027',display_name='tempest-VolumesGetTest-Volume-911989233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d5e11c-0a24-438a-90b4-505bd31cb206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9236491994a442cbb17eb42f3506565d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:22Z,use_quota=True,user_id='abb0ec69ea974da1a5242ee95980a3dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Creating volume a9d5e11c-0a24-438a-90b4-505bd31cb206 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:02:27 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:02:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9d5e11c-0a24-438a-90b4-505bd31cb206 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:27 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9d5e11c-0a24-438a-90b4-505bd31cb206 1073741824 Jul 18 06:02:27 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:27 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c27d7179-f5db-439c-86ae-92cef0af81ff tempest-GroupSnapshotsTest-473363618 None] Create group from source-snapshot-ab10d3c7-b532-4a27-979d-147b3cc87ae8 completed successfully. Jul 18 06:02:27 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9d5e11c-0a24-438a-90b4-505bd31cb206 1073741824" returned: 0 in 0.633s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9d5e11c-0a24-438a-90b4-505bd31cb206 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:27 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9d5e11c-0a24-438a-90b4-505bd31cb206 Jul 18 06:02:27 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-bf474671-fda0-4d93-9055-a054d5cf58c3" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-bf474671-fda0-4d93-9055-a054d5cf58c3" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b77281b-e71f-41be-9ecc-4971aad5dbe4]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:28 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9d5e11c-0a24-438a-90b4-505bd31cb206" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674aa693-70e0-48b1-91c7-838f6925bc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d5e11c-0a24-438a-90b4-505bd31cb206', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed5151d-cef6-433d-aa91-6e36a695d1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:28 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Volume volume-a9d5e11c-0a24-438a-90b4-505bd31cb206 (a9d5e11c-0a24-438a-90b4-505bd31cb206): created successfully Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed5151d-cef6-433d-aa91-6e36a695d1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Flow 'volume_create_manager' (22998f91-2c65-4eed-9c73-498129f8bd7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:28 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3 Jul 18 06:02:28 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2cb33186-0362-4eed-b2ed-dc1cd3baf61c tempest-VolumesGetTest-1891977562 None] Created volume successfully. Jul 18 06:02:28 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3" returned: 0 in 0.396s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:28 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3 Jul 18 06:02:28 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:28 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf474671-fda0-4d93-9055-a054d5cf58c3" returned: 0 in 0.259s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-bf474671-fda0-4d93-9055-a054d5cf58c3" released by "delete_volume" :: held 0.709s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Created reservations ['07858bde-421d-4cfb-ac88-56b49b3e25d0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:02:28 devstack cinder-volume[87750]: WARNING cinder.quota [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-439695663 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-439695663, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:02:28 devstack cinder-volume[87750]: WARNING cinder.quota [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-439695663 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-439695663, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Created reservations ['66c3ee97-3c47-48a5-8ca4-09840733d611', '1e1871f3-8cc5-4cc3-88f4-e384b0488d09', 'ce96358c-cbbb-4507-9ea4-ee7321ba1846', '31b36875-0d89-4271-a085-ebdfcf210cbc'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-a9d5e11c-0a24-438a-90b4-505bd31cb206-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Lock "cinder-a9d5e11c-0a24-438a-90b4-505bd31cb206-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:29 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:02:29 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-quobyte-a9d5e11c-0a24-438a-90b4-505bd31cb206" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-a9d5e11c-0a24-438a-90b4-505bd31cb206" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad3c67d-268a-4131-82b6-ceb859ec7652]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9d5e11c-0a24-438a-90b4-505bd31cb206 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] group_snapshot ab10d3c7-b532-4a27-979d-147b3cc87ae8: deleting Jul 18 06:02:29 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9d5e11c-0a24-438a-90b4-505bd31cb206 Jul 18 06:02:29 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] group_snapshot ab10d3c7-b532-4a27-979d-147b3cc87ae8: deleting {{(pid=87750) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 18 06:02:29 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.335s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:02:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8b2b599d-740a-4740-8159-1b28a06bc311 tempest-GroupSnapshotsTest-473363618 None] Delete group completed successfully. Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-bf5e86f1-1f75-4e4d-986d-944d5097d83d" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-bf5e86f1-1f75-4e4d-986d-944d5097d83d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-51ca11dd-b7c1-48bf-87a4-1615b111dd6a" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-51ca11dd-b7c1-48bf-87a4-1615b111dd6a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Deleting offline snapshot 51ca11dd-b7c1-48bf-87a4-1615b111dd6a of volume bf5e86f1-1f75-4e4d-986d-944d5097d83d {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] snapshot_file for this snap is: volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7f083e-8794-42b4-b36d-01f71155cf8d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:29 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a Jul 18 06:02:29 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:29 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9d5e11c-0a24-438a-90b4-505bd31cb206" returned: 0 in 0.569s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9d5e11c-0a24-438a-90b4-505bd31cb206 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:29 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9d5e11c-0a24-438a-90b4-505bd31cb206 Jul 18 06:02:29 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:30 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:30 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9d5e11c-0a24-438a-90b4-505bd31cb206" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a" returned: 0 in 0.530s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-a9d5e11c-0a24-438a-90b4-505bd31cb206" released by "delete_volume" :: held 0.989s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff3fd27-0bf7-4436-b529-0e4ed1df12df]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Created reservations ['c1a4e8e7-4305-43c0-91fb-1c47ee8f2a2c', '566813d0-c473-4967-99f4-5045608ccd5f', '150709dc-37f7-4aaa-8f7a-5d0c4a24ebb4', 'e0a052c3-a4dd-4197-aa5e-7379be7824ad'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:30 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d Jul 18 06:02:30 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:30 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:02:30 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:30 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:30 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d" returned: 0 in 0.467s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:02:30 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Deleted volume successfully. Jul 18 06:02:30 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a Jul 18 06:02:30 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e69699bb-2213-43aa-8298-934cfd2343d8 tempest-VolumesGetTest-1891977562 None] Lock "cinder-a9d5e11c-0a24-438a-90b4-505bd31cb206-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:31 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a" returned: 0 in 0.503s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:31 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a Jul 18 06:02:31 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-9271282b-8f0a-47ec-959a-f1ff06c4e217-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Lock "cinder-9271282b-8f0a-47ec-959a-f1ff06c4e217-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:31 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d.51ca11dd-b7c1-48bf-87a4-1615b111dd6a" returned: 0 in 0.373s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-51ca11dd-b7c1-48bf-87a4-1615b111dd6a" released by "_delete_snapshot" :: held 2.029s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Acquiring lock "cinder-quobyte-9271282b-8f0a-47ec-959a-f1ff06c4e217" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-bf5e86f1-1f75-4e4d-986d-944d5097d83d" released by "delete_snapshot" :: held 2.088s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-9271282b-8f0a-47ec-959a-f1ff06c4e217" acquired by "delete_volume" :: waited 0.046s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b741dc1c-a15c-4097-a523-8edd1647603b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:31 devstack cinder-volume[87750]: WARNING cinder.quota [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-439695663 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-439695663, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:02:31 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] Created reservations ['6490ed49-4a9f-48ac-8acf-740ecbcf76e1', '175bd619-d753-4446-891c-f8a7b4051dbb', '7ca07e2c-0635-4eb3-9af1-1c21b2f1e4c8', 'fdda4ff7-91df-4b2c-a877-d9fb9fd47173'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:02:31 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 Jul 18 06:02:31 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-834a60e3-f263-4c65-9afe-da4ff2ab38d0 tempest-GroupSnapshotsTest-473363618 None] group_snapshot ab10d3c7-b532-4a27-979d-147b3cc87ae8: deleted successfully Jul 18 06:02:32 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217" returned: 0 in 0.603s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:32 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217 Jul 18 06:02:32 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:32 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9271282b-8f0a-47ec-959a-f1ff06c4e217" returned: 0 in 0.357s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Lock "cinder-quobyte-9271282b-8f0a-47ec-959a-f1ff06c4e217" released by "delete_volume" :: held 1.036s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:32 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Created reservations ['5852a35d-a43a-47d7-8ae1-3e66d6f5ab99', '57f00c6e-98a3-4e44-a419-754fb3fca3d9', 'f6fe7a46-4e44-43db-889c-b45c93b0a245', '75045fa2-a089-44ca-bcbe-c43dbdcf1ae6'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:02:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:32 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:02:32 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-bf5e86f1-1f75-4e4d-986d-944d5097d83d" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-bf5e86f1-1f75-4e4d-986d-944d5097d83d" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:33 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9416e06-d52a-4d6a-8c62-6d64225c5480]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:33 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.511s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:33 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:02:33 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Deleted volume successfully. Jul 18 06:02:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7dd48114-251e-4f7c-b1d4-c91776a0d06f tempest-VolumesGetTest-1891977562 None] Lock "cinder-9271282b-8f0a-47ec-959a-f1ff06c4e217-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:33 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d Jul 18 06:02:33 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:33 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d" returned: 0 in 0.522s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:33 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d Jul 18 06:02:33 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:34 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bf5e86f1-1f75-4e4d-986d-944d5097d83d" returned: 0 in 0.377s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-bf5e86f1-1f75-4e4d-986d-944d5097d83d" released by "delete_volume" :: held 1.007s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:34 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Created reservations ['7e7971af-4cc5-4edc-91c3-d2a15dc63038'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:02:34 devstack cinder-volume[87750]: WARNING cinder.db.api [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-439695663'] Jul 18 06:02:34 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Created reservations ['aeaae191-08e4-4ff1-a321-d41c7882feec', '36ca0c24-771c-483a-9f37-7680934af215', '3c568422-e218-493a-b685-00c1c64db245', '6cb7eace-bcba-4de1-888f-6852258327b0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:02:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:34 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:02:34 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:35 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.373s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:02:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-757c5934-78eb-43d0-98f9-6ea47c72a7e9 tempest-GroupSnapshotsTest-473363618 None] Delete group completed successfully. Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:35 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:02:35 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:35 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.291s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:02:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:02:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d6b8ee04-3f70-47ae-b94c-e6310960654c tempest-GroupSnapshotsTest-473363618 None] Group tempest-GroupSnapshotsTest-Group-982873720: creating Jul 18 06:02:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d6b8ee04-3f70-47ae-b94c-e6310960654c tempest-GroupSnapshotsTest-473363618 None] Group tempest-GroupSnapshotsTest-Group-982873720: created successfully Jul 18 06:02:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d6b8ee04-3f70-47ae-b94c-e6310960654c tempest-GroupSnapshotsTest-473363618 None] Create group completed successfully. Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Flow 'volume_create_manager' (483e99d2-57e2-4a0d-8df2-b65514da585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a07f2f7-da9e-4c30-965d-716f91b3aaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a07f2f7-da9e-4c30-965d-716f91b3aaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1748972561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3de26509-2e7d-4dc5-ac08-e3bd54ef43a2,host='devstack@QuobyteHD#QuobyteHD',id=adfb5196-7029-44ba-97c1-b60395b605a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13999ad858fd4cbe8524f040b3582477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:39Z,use_quota=True,user_id='92364ca2f8fc441eb3015f960f312c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55b220b6-7dec-492f-8223-9c0ce4a10c2c),volume_type_id=55b220b6-7dec-492f-8223-9c0ce4a10c2c)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fdcb51-02c9-4453-9b3e-6f36a61753ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fdcb51-02c9-4453-9b3e-6f36a61753ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d708798-3b97-453c-99f1-a10619158253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d708798-3b97-453c-99f1-a10619158253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adfb5196-7029-44ba-97c1-b60395b605a7', 'volume_name': 'volume-adfb5196-7029-44ba-97c1-b60395b605a7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74d986d-52f5-48aa-a277-3d928cc7960f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74d986d-52f5-48aa-a277-3d928cc7960f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557f2e31-55d1-492d-9c0d-467d03623fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Volume adfb5196-7029-44ba-97c1-b60395b605a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adfb5196-7029-44ba-97c1-b60395b605a7', 'volume_size': 1} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3de26509-2e7d-4dc5-ac08-e3bd54ef43a2,created_at=2026-07-18T04:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1748972561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3de26509-2e7d-4dc5-ac08-e3bd54ef43a2,host='devstack@QuobyteHD#QuobyteHD',id=adfb5196-7029-44ba-97c1-b60395b605a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13999ad858fd4cbe8524f040b3582477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:39Z,use_quota=True,user_id='92364ca2f8fc441eb3015f960f312c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55b220b6-7dec-492f-8223-9c0ce4a10c2c),volume_type_id=55b220b6-7dec-492f-8223-9c0ce4a10c2c)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Creating volume adfb5196-7029-44ba-97c1-b60395b605a7 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:02:39 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:02:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:39 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 1073741824 Jul 18 06:02:39 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:40 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 1073741824" returned: 0 in 1.348s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:41 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 Jul 18 06:02:41 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:41 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7" returned: 0 in 0.438s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:02:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557f2e31-55d1-492d-9c0d-467d03623fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adfb5196-7029-44ba-97c1-b60395b605a7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a5c13b-4f0e-484e-a1c6-153a92a825cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Volume volume-adfb5196-7029-44ba-97c1-b60395b605a7 (adfb5196-7029-44ba-97c1-b60395b605a7): created successfully Jul 18 06:02:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a5c13b-4f0e-484e-a1c6-153a92a825cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Flow 'volume_create_manager' (483e99d2-57e2-4a0d-8df2-b65514da585c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6ee40d40-8de5-44bc-97cc-5073b430cc70 tempest-GroupSnapshotsTest-473363618 None] Created volume successfully. Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Flow 'volume_create_manager' (d4c4278d-e20a-41af-9130-f0846ca7f09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8346b0-8936-4be7-9dd4-97af3122ea8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8346b0-8936-4be7-9dd4-97af3122ea8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-298997040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3de26509-2e7d-4dc5-ac08-e3bd54ef43a2,host='devstack@QuobyteHD#QuobyteHD',id=91931a5c-289c-44d9-84fc-6cc048080d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13999ad858fd4cbe8524f040b3582477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:43Z,use_quota=True,user_id='92364ca2f8fc441eb3015f960f312c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55b220b6-7dec-492f-8223-9c0ce4a10c2c),volume_type_id=55b220b6-7dec-492f-8223-9c0ce4a10c2c)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ce07c2-a360-4ae2-ac1f-54bf37497c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ce07c2-a360-4ae2-ac1f-54bf37497c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4db17a7-5128-4f0c-a6d5-420f182b98f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4db17a7-5128-4f0c-a6d5-420f182b98f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91931a5c-289c-44d9-84fc-6cc048080d64', 'volume_name': 'volume-91931a5c-289c-44d9-84fc-6cc048080d64', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaaeca8-7893-427b-8b13-067265cbfc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaaeca8-7893-427b-8b13-067265cbfc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b0d376-48cf-4bee-8aa5-6f31d8e10719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Volume 91931a5c-289c-44d9-84fc-6cc048080d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91931a5c-289c-44d9-84fc-6cc048080d64', 'volume_size': 1} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3de26509-2e7d-4dc5-ac08-e3bd54ef43a2,created_at=2026-07-18T04:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-298997040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3de26509-2e7d-4dc5-ac08-e3bd54ef43a2,host='devstack@QuobyteHD#QuobyteHD',id=91931a5c-289c-44d9-84fc-6cc048080d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13999ad858fd4cbe8524f040b3582477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:43Z,use_quota=True,user_id='92364ca2f8fc441eb3015f960f312c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(55b220b6-7dec-492f-8223-9c0ce4a10c2c),volume_type_id=55b220b6-7dec-492f-8223-9c0ce4a10c2c)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Creating volume 91931a5c-289c-44d9-84fc-6cc048080d64 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:02:43 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:02:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:43 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 1073741824 Jul 18 06:02:43 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:44 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 1073741824" returned: 0 in 0.679s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:44 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 Jul 18 06:02:44 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:44 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64" returned: 0 in 0.614s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:02:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b0d376-48cf-4bee-8aa5-6f31d8e10719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91931a5c-289c-44d9-84fc-6cc048080d64', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc52f521-f320-4650-804c-44beb69d78d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:45 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Volume volume-91931a5c-289c-44d9-84fc-6cc048080d64 (91931a5c-289c-44d9-84fc-6cc048080d64): created successfully Jul 18 06:02:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc52f521-f320-4650-804c-44beb69d78d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Flow 'volume_create_manager' (d4c4278d-e20a-41af-9130-f0846ca7f09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cd87aab1-2b56-424c-8bc5-8502d5669e1c tempest-GroupSnapshotsTest-473363618 None] Created volume successfully. Jul 18 06:02:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6f56ffa3-2280-4717-8d2f-4e8c8983c7cb tempest-GroupSnapshotsTest-473363618 None] Update group completed successfully. Jul 18 06:02:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8d2f2f93-38d1-46ea-9c4d-7ec70cc5cc99 tempest-GroupSnapshotsTest-473363618 None] Update group completed successfully. Jul 18 06:02:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-dc219fe7-618e-47b3-8db8-4bfed48df57f tempest-GroupSnapshotsTest-473363618 None] Update group completed successfully. Jul 18 06:02:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-220ff78d-5497-4ab8-8935-e5889c9badb4 tempest-GroupSnapshotsTest-473363618 None] Update group completed successfully. Jul 18 06:02:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] GroupSnapshot ef1c6f3e-3e17-426b-a8a5-42d82a63c322: creating. Jul 18 06:02:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Group snapshot ef1c6f3e-3e17-426b-a8a5-42d82a63c322: creating. {{(pid=87750) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 18 06:02:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Creating offline snapshot 8dd314ad-8260-4ff8-ba70-de5cafb06160 of volume adfb5196-7029-44ba-97c1-b60395b605a7 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:02:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af302ae-d846-4e8e-8c5e-0bb4054b0358]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:53 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 Jul 18 06:02:53 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:53 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7" returned: 0 in 0.631s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:53 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 1G Jul 18 06:02:53 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:54 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 1G" returned: 0 in 0.567s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfb5196-7029-44ba-97c1-b60395b605a7 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:54 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfb5196-7029-44ba-97c1-b60395b605a7 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 Jul 18 06:02:54 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:54 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adfb5196-7029-44ba-97c1-b60395b605a7 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160" returned: 0 in 0.450s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:54 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:02:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:54 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 Jul 18 06:02:54 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:55 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160" returned: 0 in 0.365s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:55 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.info Jul 18 06:02:55 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:55 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.info" returned: 0 in 0.314s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:55 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:55 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.info Jul 18 06:02:55 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:02:55 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Flow 'volume_create_manager' (0eeb8f26-0e93-447b-bbcf-42b13dc55bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a2c934-0cf3-4e54-9538-252adc23be28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.info" returned: 0 in 0.358s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.859s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a2c934-0cf3-4e54-9538-252adc23be28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-714666626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003813d4-dabb-4133-92f3-f821ae406b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91acdb7963874c87a0a062c81397b32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:56Z,use_quota=True,user_id='95ca91576b6a44af89312044e561dfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893daa5e-2aea-4e5c-befe-88ec34cba6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893daa5e-2aea-4e5c-befe-88ec34cba6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa253f87-e21f-4250-848e-88b9078f3cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa253f87-e21f-4250-848e-88b9078f3cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '003813d4-dabb-4133-92f3-f821ae406b03', 'volume_name': 'volume-003813d4-dabb-4133-92f3-f821ae406b03', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aafd8dc-2440-4052-935a-3c2280ca0aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aafd8dc-2440-4052-935a-3c2280ca0aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de46212-f585-4e04-aa71-9dae45e636b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:55 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Volume 003813d4-dabb-4133-92f3-f821ae406b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-003813d4-dabb-4133-92f3-f821ae406b03', 'volume_size': 1} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Creating offline snapshot f0b8988f-3faf-495c-9068-3d1257d87fcf of volume 91931a5c-289c-44d9-84fc-6cc048080d64 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77db237-c4a4-4fdf-9721-469e19440919]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:55 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 Jul 18 06:02:55 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:56 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64" returned: 0 in 0.395s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:56 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf 1G Jul 18 06:02:56 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:56 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf 1G" returned: 0 in 0.418s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91931a5c-289c-44d9-84fc-6cc048080d64 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:56 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91931a5c-289c-44d9-84fc-6cc048080d64 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf Jul 18 06:02:56 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:56 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91931a5c-289c-44d9-84fc-6cc048080d64 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:56 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:02:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:56 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf Jul 18 06:02:56 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:57 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf" returned: 0 in 0.257s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:57 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.info Jul 18 06:02:57 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:57 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.info" returned: 0 in 0.281s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:57 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.info is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:57 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.info Jul 18 06:02:57 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:57 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.info" returned: 0 in 0.271s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.990s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-714666626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=003813d4-dabb-4133-92f3-f821ae406b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91acdb7963874c87a0a062c81397b32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:02:56Z,use_quota=True,user_id='95ca91576b6a44af89312044e561dfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Creating volume 003813d4-dabb-4133-92f3-f821ae406b03 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:02:57 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:02:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:57 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 1073741824 Jul 18 06:02:57 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4258a6ed-a28f-40dc-a40e-97a01e12f80d tempest-GroupSnapshotsTest-473363618 None] group_snapshot ef1c6f3e-3e17-426b-a8a5-42d82a63c322: created successfully Jul 18 06:02:58 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 1073741824" returned: 0 in 0.541s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] group_snapshot ef1c6f3e-3e17-426b-a8a5-42d82a63c322: deleting Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] group_snapshot ef1c6f3e-3e17-426b-a8a5-42d82a63c322: deleting {{(pid=87750) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:58 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 Jul 18 06:02:58 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-adfb5196-7029-44ba-97c1-b60395b605a7" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-adfb5196-7029-44ba-97c1-b60395b605a7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-8dd314ad-8260-4ff8-ba70-de5cafb06160" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-8dd314ad-8260-4ff8-ba70-de5cafb06160" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Deleting offline snapshot 8dd314ad-8260-4ff8-ba70-de5cafb06160 of volume adfb5196-7029-44ba-97c1-b60395b605a7 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] snapshot_file for this snap is: volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9a5e43-9e2b-4d10-8b70-254bb376132f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:58 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 Jul 18 06:02:58 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:58 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03" returned: 0 in 0.308s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de46212-f585-4e04-aa71-9dae45e636b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-003813d4-dabb-4133-92f3-f821ae406b03', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c164ed10-1bef-483f-848b-4a3452c47f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=132,cinder:SELECT=121,cinder:INSERT=37,cinder:DELETE=12 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:02:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Volume volume-003813d4-dabb-4133-92f3-f821ae406b03 (003813d4-dabb-4133-92f3-f821ae406b03): created successfully Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c164ed10-1bef-483f-848b-4a3452c47f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Flow 'volume_create_manager' (0eeb8f26-0e93-447b-bbcf-42b13dc55bbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:02:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7232de84-7339-4434-9c93-9e311ccaee37 tempest-VolumesSnapshotTestJSON-894130153 None] Created volume successfully. Jul 18 06:02:58 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160" returned: 0 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adfb5196-7029-44ba-97c1-b60395b605a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacf55b1-b254-4dfe-a866-d850b1ff9b85]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:02:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:59 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 Jul 18 06:02:59 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:59 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:59 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 Jul 18 06:02:59 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:59 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160" returned: 0 in 0.335s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:02:59 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160 Jul 18 06:02:59 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:02:59 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Jul 18 06:02:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7.8dd314ad-8260-4ff8-ba70-de5cafb06160" returned: 0 in 0.266s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:02:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-8dd314ad-8260-4ff8-ba70-de5cafb06160" released by "_delete_snapshot" :: held 1.442s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-adfb5196-7029-44ba-97c1-b60395b605a7" released by "delete_snapshot" :: held 1.475s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:02:59 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=108,cinder:UPDATE=118,cinder:DELETE=4,cinder:INSERT=30 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:02:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-91931a5c-289c-44d9-84fc-6cc048080d64" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:02:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-91931a5c-289c-44d9-84fc-6cc048080d64" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:02:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-f0b8988f-3faf-495c-9068-3d1257d87fcf" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-f0b8988f-3faf-495c-9068-3d1257d87fcf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Deleting offline snapshot f0b8988f-3faf-495c-9068-3d1257d87fcf of volume 91931a5c-289c-44d9-84fc-6cc048080d64 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] snapshot_file for this snap is: volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd27922-64b6-4e9e-aa87-4e179ed7a162]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:00 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:00 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] Creating offline snapshot cd2ddb00-67d4-4321-bed2-a20de9f31dd1 of volume 003813d4-dabb-4133-92f3-f821ae406b03 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b6554b-f081-48ac-8ea5-97948854d176]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:00 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 Jul 18 06:03:00 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:00 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf" returned: 0 in 0.364s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91931a5c-289c-44d9-84fc-6cc048080d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb5dd11-e689-4da6-bff0-7ac197ba6906]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:00 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 Jul 18 06:03:00 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:00 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03" returned: 0 in 0.366s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:00 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 1G Jul 18 06:03:00 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:00 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64" returned: 0 in 0.376s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:00 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf Jul 18 06:03:00 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:01 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 1G" returned: 0 in 0.487s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-003813d4-dabb-4133-92f3-f821ae406b03 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:01 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-003813d4-dabb-4133-92f3-f821ae406b03 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 Jul 18 06:03:01 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:01 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf" returned: 0 in 0.411s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:01 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf Jul 18 06:03:01 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:01 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-003813d4-dabb-4133-92f3-f821ae406b03 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1" returned: 0 in 0.333s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:01 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 is being set with open permissions: ugo+rw Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:01 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 Jul 18 06:03:01 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:01 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64.f0b8988f-3faf-495c-9068-3d1257d87fcf" returned: 0 in 0.266s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-f0b8988f-3faf-495c-9068-3d1257d87fcf" released by "_delete_snapshot" :: held 1.520s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-91931a5c-289c-44d9-84fc-6cc048080d64" released by "delete_snapshot" :: held 1.547s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:01 devstack cinder-volume[87750]: WARNING cinder.quota [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-683859628 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-683859628, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:03:01 devstack cinder-volume[87750]: WARNING cinder.quota [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-683859628 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-683859628, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Created reservations ['fab62ce5-5f3f-4b77-940d-4dd3d8aaf4e9', 'b91d5e83-f324-4e85-8911-8fcfdf330a40', '39deed87-eab7-4059-af9c-34c1d15527a0', '8ba670ab-187b-46f5-87a9-74bf03312ed3'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:01 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1" returned: 0 in 0.271s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:01 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.info Jul 18 06:03:01 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] Created reservations ['11225157-5351-430d-8669-d122ff011e47', 'fdd8b271-7147-49f5-9a3d-7557fe46a986', 'bdaca9e9-6018-44e1-bb5b-b5738365be1b', '67d69e11-fe14-41c1-a4a1-0d8f821d2ec9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7ab300a8-76ad-4e83-be2d-890618f3df8f tempest-GroupSnapshotsTest-473363618 None] group_snapshot ef1c6f3e-3e17-426b-a8a5-42d82a63c322: deleted successfully Jul 18 06:03:02 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.info" returned: 0 in 0.298s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:02 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.info is being set with open permissions: ugo+rw Jul 18 06:03:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:02 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.info Jul 18 06:03:02 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:02 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.info" returned: 0 in 0.271s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-91931a5c-289c-44d9-84fc-6cc048080d64" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-91931a5c-289c-44d9-84fc-6cc048080d64" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3b0d1d-edc8-4ea5-a43d-24a2f842b324]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-29ac4afe-a273-418f-ae7d-24ba10bcc868 tempest-VolumesSnapshotTestJSON-894130153 None] Create snapshot completed successfully Jul 18 06:03:02 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 Jul 18 06:03:02 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:02 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:02 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64 Jul 18 06:03:02 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:03 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-91931a5c-289c-44d9-84fc-6cc048080d64" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-91931a5c-289c-44d9-84fc-6cc048080d64" released by "delete_volume" :: held 0.705s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-adfb5196-7029-44ba-97c1-b60395b605a7" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-adfb5196-7029-44ba-97c1-b60395b605a7" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1a9fe9-e1d7-4a6e-beda-0e8cc64968f0]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:03 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 Jul 18 06:03:03 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-cd2ddb00-67d4-4321-bed2-a20de9f31dd1-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-cd2ddb00-67d4-4321-bed2-a20de9f31dd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-003813d4-dabb-4133-92f3-f821ae406b03" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:03 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7" returned: 0 in 0.417s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-003813d4-dabb-4133-92f3-f821ae406b03" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-cd2ddb00-67d4-4321-bed2-a20de9f31dd1" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-cd2ddb00-67d4-4321-bed2-a20de9f31dd1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:03 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7 Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Deleting offline snapshot cd2ddb00-67d4-4321-bed2-a20de9f31dd1 of volume 003813d4-dabb-4133-92f3-f821ae406b03 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:03:03 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] snapshot_file for this snap is: volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7de8748-2882-4cb9-a866-32902a209ee8]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:03 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 Jul 18 06:03:03 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:03 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-adfb5196-7029-44ba-97c1-b60395b605a7" returned: 0 in 0.310s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-adfb5196-7029-44ba-97c1-b60395b605a7" released by "delete_volume" :: held 0.794s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:03 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Created reservations ['cbdec165-38bc-4a96-8e9a-b9573098676e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:04 devstack cinder-volume[87750]: WARNING cinder.quota [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-683859628 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-683859628, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Created reservations ['817b8506-3427-4df0-9e89-db378178a643', '8158a604-4c53-4089-844c-3947166aed88', 'f5a35caf-0fdd-4841-a144-2088e8fd7bbd', 'da2575e5-b8f3-4126-95d8-f51a38ca5ba1'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:04 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1" returned: 0 in 0.462s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-003813d4-dabb-4133-92f3-f821ae406b03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7550da0-c71d-42bf-aecc-a4ce6fc3804f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Flow 'volume_create_manager' (fbb534d4-8951-4293-90e5-0e97bf736d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8003986-f6ed-485f-a81a-6e3010977854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8003986-f6ed-485f-a81a-6e3010977854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2124237930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5179df10-95c2-4e4a-879e-7d244e43d7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd6c7a4f1dd4619b18aee06fb68a7d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:04Z,use_quota=True,user_id='f955832c646e4e50aa7cdfb4e8bf2b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc866ba-5a6e-45c1-b89c-71d7d912da0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc866ba-5a6e-45c1-b89c-71d7d912da0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800b0541-ad6b-4a04-9082-aacd2267ee5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800b0541-ad6b-4a04-9082-aacd2267ee5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5179df10-95c2-4e4a-879e-7d244e43d7f9', 'volume_name': 'volume-5179df10-95c2-4e4a-879e-7d244e43d7f9', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab453bfb-4d1b-45ba-8165-506b3fa54ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab453bfb-4d1b-45ba-8165-506b3fa54ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab3e0c9-d3f7-441b-a59d-bbbd2a918b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Volume 5179df10-95c2-4e4a-879e-7d244e43d7f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5179df10-95c2-4e4a-879e-7d244e43d7f9', 'volume_size': 1} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2124237930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5179df10-95c2-4e4a-879e-7d244e43d7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd6c7a4f1dd4619b18aee06fb68a7d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:04Z,use_quota=True,user_id='f955832c646e4e50aa7cdfb4e8bf2b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Creating volume 5179df10-95c2-4e4a-879e-7d244e43d7f9 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:04 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:04 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:03:04 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5179df10-95c2-4e4a-879e-7d244e43d7f9 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:04 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5179df10-95c2-4e4a-879e-7d244e43d7f9 1073741824 Jul 18 06:03:04 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Created reservations ['d4147f46-7c0a-4ac4-928c-82a7d99675e4', '02c37f53-d4eb-414c-818a-6d7850980e86', '58d0e5cf-651c-4d5a-91f5-a8a131a0bf7e', 'bbe8af1a-b516-458a-92bd-598b8c80209a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:04 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:03:04 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:04 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03" returned: 0 in 0.469s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:04 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 Jul 18 06:03:04 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:04 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.352s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:03:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-64479f84-1458-40d5-bfee-a7883ea4c7d8 tempest-GroupSnapshotsTest-473363618 None] Delete group completed successfully. Jul 18 06:03:04 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5179df10-95c2-4e4a-879e-7d244e43d7f9 1073741824" returned: 0 in 0.694s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5179df10-95c2-4e4a-879e-7d244e43d7f9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:05 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5179df10-95c2-4e4a-879e-7d244e43d7f9 Jul 18 06:03:05 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:05 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1" returned: 0 in 0.565s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:05 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1 Jul 18 06:03:05 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:05 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5179df10-95c2-4e4a-879e-7d244e43d7f9" returned: 0 in 0.333s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ab3e0c9-d3f7-441b-a59d-bbbd2a918b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5179df10-95c2-4e4a-879e-7d244e43d7f9', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf24e05a-4287-4160-ab3f-0e55c5fdd17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:05 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Volume volume-5179df10-95c2-4e4a-879e-7d244e43d7f9 (5179df10-95c2-4e4a-879e-7d244e43d7f9): created successfully Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf24e05a-4287-4160-ab3f-0e55c5fdd17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Flow 'volume_create_manager' (fbb534d4-8951-4293-90e5-0e97bf736d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2952c08b-e36e-446c-a03f-b348f3b2c867 tempest-GroupSnapshotsTest-473363618 None] Group tempest-GroupSnapshotsTest-Group-580195002: creating Jul 18 06:03:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cdf272c1-0e2d-487c-90d7-e6f9373bb606 tempest-AttachVolumeNegativeTest-277769288 None] Created volume successfully. Jul 18 06:03:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2952c08b-e36e-446c-a03f-b348f3b2c867 tempest-GroupSnapshotsTest-473363618 None] Group tempest-GroupSnapshotsTest-Group-580195002: created successfully Jul 18 06:03:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2952c08b-e36e-446c-a03f-b348f3b2c867 tempest-GroupSnapshotsTest-473363618 None] Create group completed successfully. Jul 18 06:03:05 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03.cd2ddb00-67d4-4321-bed2-a20de9f31dd1" returned: 0 in 0.329s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-cd2ddb00-67d4-4321-bed2-a20de9f31dd1" released by "_delete_snapshot" :: held 1.945s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-003813d4-dabb-4133-92f3-f821ae406b03" released by "delete_snapshot" :: held 1.974s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:05 devstack cinder-volume[87750]: WARNING cinder.quota [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Created reservations ['1b360cff-1dfa-4812-b770-e3f9a21546a6', '9266ed6e-73df-4edb-9fa1-f5bf24021f42', 'b4868201-2c83-466e-b7ae-082d24f20ae9', 'e80f20a0-02f4-4682-a1d7-2db22a8c372e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Delete snapshot completed successfully. Jul 18 06:03:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dc8f9b95-329e-4b34-8340-0048e1d984c8 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-cd2ddb00-67d4-4321-bed2-a20de9f31dd1-delete_snapshot" released by "delete_snapshot" :: held 2.173s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Flow 'volume_create_manager' (5e9707fb-5e70-4cab-aba6-ffdf820023ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6710ec2-0181-40e1-8cb3-856e5a33e187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6710ec2-0181-40e1-8cb3-856e5a33e187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1584990989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ab11e7e3-579c-4720-9dc6-d821a883b374,host='devstack@QuobyteHD#QuobyteHD',id=dfc82358-0afe-4b91-9e74-7fa6ac1c66de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13999ad858fd4cbe8524f040b3582477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:07Z,use_quota=True,user_id='92364ca2f8fc441eb3015f960f312c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3ef0d70-6bfd-43fd-bf20-0afb471266f2),volume_type_id=e3ef0d70-6bfd-43fd-bf20-0afb471266f2)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54a2d03-215c-4e29-aa3a-879afa3cc5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54a2d03-215c-4e29-aa3a-879afa3cc5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf526d9b-1909-495d-867e-65362fa66ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf526d9b-1909-495d-867e-65362fa66ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfc82358-0afe-4b91-9e74-7fa6ac1c66de', 'volume_name': 'volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a50e948-deff-4829-819e-aeabdf299c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a50e948-deff-4829-819e-aeabdf299c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd9561c-7c87-4428-8f28-97ae413d0fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:07 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Volume dfc82358-0afe-4b91-9e74-7fa6ac1c66de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de', 'volume_size': 1} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ab11e7e3-579c-4720-9dc6-d821a883b374,created_at=2026-07-18T04:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1584990989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ab11e7e3-579c-4720-9dc6-d821a883b374,host='devstack@QuobyteHD#QuobyteHD',id=dfc82358-0afe-4b91-9e74-7fa6ac1c66de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13999ad858fd4cbe8524f040b3582477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:07Z,use_quota=True,user_id='92364ca2f8fc441eb3015f960f312c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e3ef0d70-6bfd-43fd-bf20-0afb471266f2),volume_type_id=e3ef0d70-6bfd-43fd-bf20-0afb471266f2)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Creating volume dfc82358-0afe-4b91-9e74-7fa6ac1c66de {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:03:07 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:07 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de 1073741824 Jul 18 06:03:07 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-0ee83778-ef39-4542-87c4-46f2bd13888b req-7af083a8-0439-47f8-bc01-4cfc3e327880 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Flow 'volume_create_manager' (1d2645b3-2ac9-4cfd-b0f9-6914338e3b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a6764c-057d-417d-ac4f-ae6d50c7e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a6764c-057d-417d-ac4f-ae6d50c7e393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1742940503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fe3761-8dd4-449a-8f93-4048df668471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91acdb7963874c87a0a062c81397b32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:07Z,use_quota=True,user_id='95ca91576b6a44af89312044e561dfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2861e2-615c-49ef-bd7b-e3d06535fce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2861e2-615c-49ef-bd7b-e3d06535fce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5057275f-d802-4355-95b9-bf3759f1386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5057275f-d802-4355-95b9-bf3759f1386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7fe3761-8dd4-449a-8f93-4048df668471', 'volume_name': 'volume-b7fe3761-8dd4-449a-8f93-4048df668471', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bb7cb8-e82c-4717-9c0a-de90376c8eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bb7cb8-e82c-4717-9c0a-de90376c8eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542745e6-2dfe-4978-a080-17fba8ced946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:07 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Volume b7fe3761-8dd4-449a-8f93-4048df668471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7fe3761-8dd4-449a-8f93-4048df668471', 'volume_size': 1} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:07 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de 1073741824" returned: 0 in 0.446s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:07 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de Jul 18 06:03:07 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:07 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de" returned: 0 in 0.253s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-0ee83778-ef39-4542-87c4-46f2bd13888b req-7af083a8-0439-47f8-bc01-4cfc3e327880 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.620s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd9561c-7c87-4428-8f28-97ae413d0fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819cda79-877b-4a58-955a-f9ea1afd621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-0ee83778-ef39-4542-87c4-46f2bd13888b req-7af083a8-0439-47f8-bc01-4cfc3e327880 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1742940503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fe3761-8dd4-449a-8f93-4048df668471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91acdb7963874c87a0a062c81397b32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:07Z,use_quota=True,user_id='95ca91576b6a44af89312044e561dfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Creating volume b7fe3761-8dd4-449a-8f93-4048df668471 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:03:07 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:03:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Volume volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de (dfc82358-0afe-4b91-9e74-7fa6ac1c66de): created successfully Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819cda79-877b-4a58-955a-f9ea1afd621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:08 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 1073741824 Jul 18 06:03:08 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Flow 'volume_create_manager' (5e9707fb-5e70-4cab-aba6-ffdf820023ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cce46093-67d3-4246-881a-c4a521d11286 tempest-GroupSnapshotsTest-473363618 None] Created volume successfully. Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-0ee83778-ef39-4542-87c4-46f2bd13888b req-7af083a8-0439-47f8-bc01-4cfc3e327880 tempest-AttachVolumeNegativeTest-277769288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-5179df10-95c2-4e4a-879e-7d244e43d7f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ab914c9-b393-4775-a711-1a83193e9079', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:03:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-0ee83778-ef39-4542-87c4-46f2bd13888b req-7af083a8-0439-47f8-bc01-4cfc3e327880 tempest-AttachVolumeNegativeTest-277769288 None] attachment_update completed successfully. Jul 18 06:03:08 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 1073741824" returned: 0 in 0.627s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Flow 'volume_create_manager' (ce58afcb-ac55-4bd4-bb4a-22411ed7cb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd5d4e4-a568-47dd-86a6-95d7dc30008e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd5d4e4-a568-47dd-86a6-95d7dc30008e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1031979040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a32090ce18545ca93124d5855db211d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:09Z,use_quota=True,user_id='a4ae47bb938247beb2444e763edb58f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999f581d-5312-49cb-bac6-a4da7ed84b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999f581d-5312-49cb-bac6-a4da7ed84b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd00f6d7-4bc9-4dd7-a17e-bb95b3bc994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd00f6d7-4bc9-4dd7-a17e-bb95b3bc994b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1', 'volume_name': 'volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b72bf1-a3de-45c4-9dba-f00ef7283da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b72bf1-a3de-45c4-9dba-f00ef7283da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455b43a8-517d-491d-9b7a-be24ca960724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Volume 014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1', 'volume_size': 1} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] GroupSnapshot 74d19a20-3fe0-41c9-8fca-18c6cfff947a: creating. Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] Group snapshot 74d19a20-3fe0-41c9-8fca-18c6cfff947a: creating. {{(pid=87750) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 18 06:03:08 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 Jul 18 06:03:08 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:09 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.312s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1031979040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a32090ce18545ca93124d5855db211d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:09Z,use_quota=True,user_id='a4ae47bb938247beb2444e763edb58f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Creating volume 014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:03:09 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (542745e6-2dfe-4978-a080-17fba8ced946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7fe3761-8dd4-449a-8f93-4048df668471', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:09 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1 1073741824 Jul 18 06:03:09 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887399b6-9c1f-4c21-b841-6de72a2eede4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:09 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Volume volume-b7fe3761-8dd4-449a-8f93-4048df668471 (b7fe3761-8dd4-449a-8f93-4048df668471): created successfully Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887399b6-9c1f-4c21-b841-6de72a2eede4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Flow 'volume_create_manager' (1d2645b3-2ac9-4cfd-b0f9-6914338e3b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7e7d0762-9073-4d7b-9740-4d06b9f75016 tempest-VolumesSnapshotTestJSON-894130153 None] Created volume successfully. Jul 18 06:03:09 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1 1073741824" returned: 0 in 0.402s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:09 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1 Jul 18 06:03:09 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:09 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455b43a8-517d-491d-9b7a-be24ca960724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb804c8-46ba-4dc3-a70e-5200cc2190d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] Creating offline snapshot 8f59750c-6b6a-4233-a373-86501e97a9ce of volume b7fe3761-8dd4-449a-8f93-4048df668471 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:03:09 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Volume volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1 (014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1): created successfully Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb804c8-46ba-4dc3-a70e-5200cc2190d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Flow 'volume_create_manager' (ce58afcb-ac55-4bd4-bb4a-22411ed7cb4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0515684b-ec91-43b7-93ae-2e3ff3ff18ba]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7fa0cdd1-a525-4b7e-ad0c-4b0c6854e7a1 tempest-AttachVolumeTestJSON-231829717 None] Created volume successfully. Jul 18 06:03:09 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 Jul 18 06:03:09 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:10 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471" returned: 0 in 0.361s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:10 devstack sudo[95154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce 1G Jul 18 06:03:10 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:10 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce 1G" returned: 0 in 0.464s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7fe3761-8dd4-449a-8f93-4048df668471 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:10 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7fe3761-8dd4-449a-8f93-4048df668471 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce Jul 18 06:03:10 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:11 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7fe3761-8dd4-449a-8f93-4048df668471 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:11 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce is being set with open permissions: ugo+rw Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:11 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce Jul 18 06:03:11 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:11 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce" returned: 0 in 0.302s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:11 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.info Jul 18 06:03:11 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-fda52c95-37b0-4c03-bdf0-ca013a69e75c req-c9dbc13e-5c17-4f36-b733-052796d4389b tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:11 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.info" returned: 0 in 0.260s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:11 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.info is being set with open permissions: ugo+rw Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:11 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.info Jul 18 06:03:11 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:11 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.info" returned: 0 in 0.254s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.111s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] Creating offline snapshot d1bca2f1-8fc0-4398-8012-d4ddbff9410d of volume dfc82358-0afe-4b91-9e74-7fa6ac1c66de {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec9276e-be94-4f46-90e2-3ab836b43f68]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-47c4949f-3305-481c-b631-54a319e759ce tempest-VolumesSnapshotTestJSON-894130153 None] Create snapshot completed successfully Jul 18 06:03:12 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de Jul 18 06:03:12 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:12 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:12 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d 1G Jul 18 06:03:12 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:12 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d 1G" returned: 0 in 0.433s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:12 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d Jul 18 06:03:12 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:13 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d" returned: 0 in 0.360s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:13 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:13 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d Jul 18 06:03:13 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:13 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d" returned: 0 in 0.293s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:13 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.info Jul 18 06:03:13 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Flow 'volume_create_manager' (2dc582b6-5daa-4b58-a75b-dd0d24913310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87bd0448-13cb-4c68-8623-48fc832fa877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87bd0448-13cb-4c68-8623-48fc832fa877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-47630080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39392514-da7e-4fd6-9692-66ed78dc03cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91acdb7963874c87a0a062c81397b32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8f59750c-6b6a-4233-a373-86501e97a9ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:14Z,use_quota=True,user_id='95ca91576b6a44af89312044e561dfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06eb8e4-adfd-4d12-98c6-a60678290daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06eb8e4-adfd-4d12-98c6-a60678290daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a41d83c-4beb-4f08-8406-8c8f56de1faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a41d83c-4beb-4f08-8406-8c8f56de1faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39392514-da7e-4fd6-9692-66ed78dc03cc', 'volume_name': 'volume-39392514-da7e-4fd6-9692-66ed78dc03cc', 'volume_size': 2, 'snapshot_id': '8f59750c-6b6a-4233-a373-86501e97a9ce'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374c3a86-a0f7-4d41-96a2-400ab469ef5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374c3a86-a0f7-4d41-96a2-400ab469ef5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5ac3d4-fb58-4ea2-8c74-00cfe05fab0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:13 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Volume 39392514-da7e-4fd6-9692-66ed78dc03cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39392514-da7e-4fd6-9692-66ed78dc03cc', 'volume_size': 2, 'snapshot_id': '8f59750c-6b6a-4233-a373-86501e97a9ce'} Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:13 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.info" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:13 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.info is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:03:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:13 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.info Jul 18 06:03:13 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:14 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.info" returned: 0 in 0.252s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-fda52c95-37b0-4c03-bdf0-ca013a69e75c req-c9dbc13e-5c17-4f36-b733-052796d4389b tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.620s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-fda52c95-37b0-4c03-bdf0-ca013a69e75c req-c9dbc13e-5c17-4f36-b733-052796d4389b tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.332s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-8f59750c-6b6a-4233-a373-86501e97a9ce-39392514-da7e-4fd6-9692-66ed78dc03cc" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-8f59750c-6b6a-4233-a373-86501e97a9ce-39392514-da7e-4fd6-9692-66ed78dc03cc" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Creating volume 39392514-da7e-4fd6-9692-66ed78dc03cc from snapshot 8f59750c-6b6a-4233-a373-86501e97a9ce {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-39392514-da7e-4fd6-9692-66ed78dc03cc" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-39392514-da7e-4fd6-9692-66ed78dc03cc" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] snapshot: 8f59750c-6b6a-4233-a373-86501e97a9ce, volume: 39392514-da7e-4fd6-9692-66ed78dc03cc, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-fda52c95-37b0-4c03-bdf0-ca013a69e75c req-c9dbc13e-5c17-4f36-b733-052796d4389b tempest-AttachVolumeTestJSON-231829717 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89812209-8cf7-44cd-8a69-9cd7d958187a', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2447be27-7e6f-4372-80d0-bbade49c39c2 tempest-GroupSnapshotsTest-473363618 None] group_snapshot 74d19a20-3fe0-41c9-8fca-18c6cfff947a: created successfully Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e287fc8-6d0e-40a6-af04-c1f2c7abe68a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-fda52c95-37b0-4c03-bdf0-ca013a69e75c req-c9dbc13e-5c17-4f36-b733-052796d4389b tempest-AttachVolumeTestJSON-231829717 None] attachment_update completed successfully. Jul 18 06:03:14 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce Jul 18 06:03:14 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:14 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce" returned: 0 in 0.449s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7fe3761-8dd4-449a-8f93-4048df668471(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[58502083-eb98-4be9-b1cb-c4854979d08b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:15 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 Jul 18 06:03:15 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] group_snapshot 74d19a20-3fe0-41c9-8fca-18c6cfff947a: deleting Jul 18 06:03:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] group_snapshot 74d19a20-3fe0-41c9-8fca-18c6cfff947a: deleting {{(pid=87750) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 18 06:03:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-dfc82358-0afe-4b91-9e74-7fa6ac1c66de" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:15 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471" returned: 0 in 0.614s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:15 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Path /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 06:03:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-dfc82358-0afe-4b91-9e74-7fa6ac1c66de" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-d1bca2f1-8fc0-4398-8012-d4ddbff9410d" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:15 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc Jul 18 06:03:15 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-d1bca2f1-8fc0-4398-8012-d4ddbff9410d" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Deleting offline snapshot d1bca2f1-8fc0-4398-8012-d4ddbff9410d of volume dfc82358-0afe-4b91-9e74-7fa6ac1c66de {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:03:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] snapshot_file for this snap is: volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:03:15 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ada04d-68b7-4654-b341-83774f7baf25]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:15 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d Jul 18 06:03:15 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:16 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d" returned: 0 in 0.535s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:03:16 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[43132883-c6f2-4c37-8398-7bd494c7dcb8]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:16 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de Jul 18 06:03:16 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Flow 'volume_create_manager' (12b6bbad-9e7f-4b4e-8f91-3b680ca1b96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f18d3da-c1f2-4692-af06-55545abb91e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f18d3da-c1f2-4692-af06-55545abb91e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-830649707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f36b305-3808-4447-8d03-fbad94430d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a32090ce18545ca93124d5855db211d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:17Z,use_quota=True,user_id='a4ae47bb938247beb2444e763edb58f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2125cf-cb7b-4433-9010-498f2e934948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:17 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2125cf-cb7b-4433-9010-498f2e934948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68479f60-4298-49e0-aa9c-39ec83ba536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68479f60-4298-49e0-aa9c-39ec83ba536e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f36b305-3808-4447-8d03-fbad94430d20', 'volume_name': 'volume-4f36b305-3808-4447-8d03-fbad94430d20', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3eba9c-4d9b-4a8f-ba32-3b4e55d59ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3eba9c-4d9b-4a8f-ba32-3b4e55d59ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96e2b77-6b40-437b-9f5c-3cf71722fa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:17 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Volume 4f36b305-3808-4447-8d03-fbad94430d20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f36b305-3808-4447-8d03-fbad94430d20', 'volume_size': 1} Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de" returned: 0 in 1.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:17 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d Jul 18 06:03:17 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:18 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d" returned: 0 in 0.906s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:18 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d Jul 18 06:03:18 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:19 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de.d1bca2f1-8fc0-4398-8012-d4ddbff9410d" returned: 0 in 0.697s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-d1bca2f1-8fc0-4398-8012-d4ddbff9410d" released by "_delete_snapshot" :: held 3.633s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-dfc82358-0afe-4b91-9e74-7fa6ac1c66de" released by "delete_snapshot" :: held 3.705s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:19 devstack cinder-volume[87750]: WARNING cinder.quota [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-288683715 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-288683715, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:03:19 devstack cinder-volume[87750]: WARNING cinder.quota [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-288683715 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-288683715, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:03:19 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] Created reservations ['34d19437-38c1-47ec-847c-9fda2f0d0072', '421b5585-ba3b-4476-a5e3-13a20b39a147', '9ebd3b9c-b1b9-4c81-95bc-9ac302127205', '1145beca-7196-48aa-bc2e-debe626761c3'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1d0b3dfe-db48-4905-8c5c-bdc3a77b8e8c tempest-GroupSnapshotsTest-473363618 None] group_snapshot 74d19a20-3fe0-41c9-8fca-18c6cfff947a: deleted successfully Jul 18 06:03:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "cinder-quobyte-dfc82358-0afe-4b91-9e74-7fa6ac1c66de" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-dfc82358-0afe-4b91-9e74-7fa6ac1c66de" acquired by "delete_volume" :: waited 0.060s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba811a23-28a3-4d75-a3c8-294b74c07e4e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:21 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de Jul 18 06:03:21 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:22 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc" returned: 0 in 6.614s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f75b392-4054-47ec-adbe-a9dab35afb53]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:22 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de" returned: 0 in 1.001s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:22 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 Jul 18 06:03:22 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de Jul 18 06:03:22 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:22 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:22 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-dfc82358-0afe-4b91-9e74-7fa6ac1c66de" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Lock "cinder-quobyte-dfc82358-0afe-4b91-9e74-7fa6ac1c66de" released by "delete_volume" :: held 1.508s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Created reservations ['5ddce0c8-ef20-4f56-9184-0a36bc84dded'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:22 devstack cinder-volume[87750]: WARNING cinder.quota [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-288683715 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-288683715, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Created reservations ['e7eb8f65-f113-4671-b75e-7fa690a15e8c', '4c95d7cd-c2e9-4396-912a-0e6d4220e63f', '7e78ab10-2efe-40a3-91e1-586b96d9ba6a', 'bc0f2dbb-ae56-466b-9908-cf4b66ee7c4e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:22 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471" returned: 0 in 0.735s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:03:22 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Converted 1024.00 MB image at 154.76 MB/s Jul 18 06:03:22 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc is being set with open permissions: ugo+rw Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:22 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc Jul 18 06:03:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:22 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:22 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:03:22 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:23 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc" returned: 0 in 0.375s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-39392514-da7e-4fd6-9692-66ed78dc03cc" released by "_copy_volume_from_snapshot" :: held 9.026s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-8f59750c-6b6a-4233-a373-86501e97a9ce-39392514-da7e-4fd6-9692-66ed78dc03cc" released by "_create_volume_from_snapshot" :: held 9.074s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.105s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.780s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-830649707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f36b305-3808-4447-8d03-fbad94430d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a32090ce18545ca93124d5855db211d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:17Z,use_quota=True,user_id='a4ae47bb938247beb2444e763edb58f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Creating volume 4f36b305-3808-4447-8d03-fbad94430d20 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:03:23 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4f36b305-3808-4447-8d03-fbad94430d20 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:23 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.375s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:03:23 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4f36b305-3808-4447-8d03-fbad94430d20 1073741824 Jul 18 06:03:23 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7adf410b-b55e-48b2-90dc-6ed2534a1f8a tempest-GroupSnapshotsTest-473363618 None] Delete group completed successfully. Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5ac3d4-fb58-4ea2-8c74-00cfe05fab0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39392514-da7e-4fd6-9692-66ed78dc03cc', 'volume_size': 2, 'snapshot_id': '8f59750c-6b6a-4233-a373-86501e97a9ce'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4894a908-cbbb-4560-ab89-ca24d84cca82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:23 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Volume volume-39392514-da7e-4fd6-9692-66ed78dc03cc (39392514-da7e-4fd6-9692-66ed78dc03cc): created successfully Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4894a908-cbbb-4560-ab89-ca24d84cca82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Flow 'volume_create_manager' (2dc582b6-5daa-4b58-a75b-dd0d24913310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-86e3c9d3-e53a-4c05-a6da-03e44fd75347 tempest-VolumesSnapshotTestJSON-894130153 None] Created volume successfully. Jul 18 06:03:23 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4f36b305-3808-4447-8d03-fbad94430d20 1073741824" returned: 0 in 0.627s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4f36b305-3808-4447-8d03-fbad94430d20 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:24 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4f36b305-3808-4447-8d03-fbad94430d20 Jul 18 06:03:24 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:24 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4f36b305-3808-4447-8d03-fbad94430d20" returned: 0 in 0.550s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-39392514-da7e-4fd6-9692-66ed78dc03cc-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96e2b77-6b40-437b-9f5c-3cf71722fa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f36b305-3808-4447-8d03-fbad94430d20', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174bd918-84fb-4621-828d-6e99923f058e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:24 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Volume volume-4f36b305-3808-4447-8d03-fbad94430d20 (4f36b305-3808-4447-8d03-fbad94430d20): created successfully Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174bd918-84fb-4621-828d-6e99923f058e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Flow 'volume_create_manager' (12b6bbad-9e7f-4b4e-8f91-3b680ca1b96b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-39392514-da7e-4fd6-9692-66ed78dc03cc-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f0aa9bfa-72c3-4351-988d-b80a4b3c0588 tempest-AttachVolumeTestJSON-231829717 None] Created volume successfully. Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-39392514-da7e-4fd6-9692-66ed78dc03cc" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-39392514-da7e-4fd6-9692-66ed78dc03cc" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ed4bb4-59f0-4aba-a382-668e51b8db93]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:24 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc Jul 18 06:03:24 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:25 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc" returned: 0 in 0.809s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:25 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc Jul 18 06:03:25 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:25 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-39392514-da7e-4fd6-9692-66ed78dc03cc" returned: 0 in 0.428s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-39392514-da7e-4fd6-9692-66ed78dc03cc" released by "delete_volume" :: held 1.314s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Created reservations ['7bf9e3a1-e2ca-4d17-9bb8-b7f35dc6474c', '09f36980-7b98-42ef-8818-3eaf576eb07e', '4c8b7ac1-bdf4-42ed-8135-439f939dbb58', '3a1198bc-4e3b-4cab-a905-ce2de053fbda'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-481338ec-1d77-4118-a038-f8a8f6bd2e27 req-4a9d00cd-4ef0-4eb5-8f08-b9c8c87a54fd tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-481338ec-1d77-4118-a038-f8a8f6bd2e27 req-4a9d00cd-4ef0-4eb5-8f08-b9c8c87a54fd tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:26 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:03:26 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-481338ec-1d77-4118-a038-f8a8f6bd2e27 req-4a9d00cd-4ef0-4eb5-8f08-b9c8c87a54fd tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-481338ec-1d77-4118-a038-f8a8f6bd2e27 req-4a9d00cd-4ef0-4eb5-8f08-b9c8c87a54fd tempest-AttachVolumeTestJSON-231829717 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-4f36b305-3808-4447-8d03-fbad94430d20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '156c8971-1201-4538-b742-51769686291b', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:03:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-481338ec-1d77-4118-a038-f8a8f6bd2e27 req-4a9d00cd-4ef0-4eb5-8f08-b9c8c87a54fd tempest-AttachVolumeTestJSON-231829717 None] attachment_update completed successfully. Jul 18 06:03:26 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.492s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:03:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Deleted volume successfully. Jul 18 06:03:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8973127-9299-4231-bc09-cda9ffe87015 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-39392514-da7e-4fd6-9692-66ed78dc03cc-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-8f59750c-6b6a-4233-a373-86501e97a9ce-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-8f59750c-6b6a-4233-a373-86501e97a9ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-b7fe3761-8dd4-449a-8f93-4048df668471" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-b7fe3761-8dd4-449a-8f93-4048df668471" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-8f59750c-6b6a-4233-a373-86501e97a9ce" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-8f59750c-6b6a-4233-a373-86501e97a9ce" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Deleting offline snapshot 8f59750c-6b6a-4233-a373-86501e97a9ce of volume b7fe3761-8dd4-449a-8f93-4048df668471 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] snapshot_file for this snap is: volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d852e584-c328-46b4-a96a-73ba63eb6425]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:27 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce Jul 18 06:03:27 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:27 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce" returned: 0 in 0.491s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7fe3761-8dd4-449a-8f93-4048df668471(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b83c4bd-86d0-4646-a874-31d6efc95573]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:27 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 Jul 18 06:03:27 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:28 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471" returned: 0 in 0.558s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:28 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce Jul 18 06:03:28 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:28 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce" returned: 0 in 0.460s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:28 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce Jul 18 06:03:28 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:29 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471.8f59750c-6b6a-4233-a373-86501e97a9ce" returned: 0 in 0.414s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-8f59750c-6b6a-4233-a373-86501e97a9ce" released by "_delete_snapshot" :: held 2.056s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-b7fe3761-8dd4-449a-8f93-4048df668471" released by "delete_snapshot" :: held 2.083s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:29 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Created reservations ['653cda31-f8a1-43d4-843f-c6dfd8811903', 'c78859e4-5f35-4c5b-a6f4-a71c3b550938', 'f1edac7e-b9da-4053-b44d-4a35e2f4afb4', 'e82ec9ff-68a0-4851-ad75-c4aab7d4dc55'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Delete snapshot completed successfully. Jul 18 06:03:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1bea3bd3-651c-4f36-884c-f0c493b18a36 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-8f59750c-6b6a-4233-a373-86501e97a9ce-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-14bb7c56-a278-4d8f-b5a2-f4d1fa501a8c req-5cbbdc5f-9d81-4722-88f5-46ecbcb50902 tempest-AttachVolumeTestJSON-231829717 None] Terminate volume connection completed successfully. Jul 18 06:03:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-14bb7c56-a278-4d8f-b5a2-f4d1fa501a8c req-5cbbdc5f-9d81-4722-88f5-46ecbcb50902 tempest-AttachVolumeTestJSON-231829717 None] Deleting attachment 89812209-8cf7-44cd-8a69-9cd7d958187a. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:03:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-b7fe3761-8dd4-449a-8f93-4048df668471-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-b7fe3761-8dd4-449a-8f93-4048df668471-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-b7fe3761-8dd4-449a-8f93-4048df668471" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-b7fe3761-8dd4-449a-8f93-4048df668471" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05f254d-2bcf-4ff1-b06f-1a22b80ef103]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:30 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 Jul 18 06:03:30 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-8a1274e7-49ca-4992-88f4-982249dd8e1d req-97912bae-4bb5-4acb-a2a9-7ec614d6124d tempest-AttachVolumeTestJSON-231829717 None] Terminate volume connection completed successfully. Jul 18 06:03:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-8a1274e7-49ca-4992-88f4-982249dd8e1d req-97912bae-4bb5-4acb-a2a9-7ec614d6124d tempest-AttachVolumeTestJSON-231829717 None] Deleting attachment 156c8971-1201-4538-b742-51769686291b. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:03:31 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471" returned: 0 in 0.542s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:31 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471 Jul 18 06:03:31 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:31 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b7fe3761-8dd4-449a-8f93-4048df668471" returned: 0 in 0.319s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-b7fe3761-8dd4-449a-8f93-4048df668471" released by "delete_volume" :: held 0.965s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:31 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Created reservations ['08dda1c3-e604-485e-bd92-f1ee4f42bdc2', 'be555da8-bd62-4657-8fb7-bd1d68b7ac9b', '6e95b39f-e3ee-4617-9a3d-1b46da5dca43', '35e7c6f8-6898-425c-85e2-8474e69147ca'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:31 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:03:31 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:32 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:32 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:03:32 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Deleted volume successfully. Jul 18 06:03:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-99541f67-c4ef-4a12-a218-c3e1beaa6e5a tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-b7fe3761-8dd4-449a-8f93-4048df668471-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Flow 'volume_create_manager' (a7896680-5918-49b9-aae6-3726c9636835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a15372-8d31-48b3-a1a1-af61510b052a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a15372-8d31-48b3-a1a1-af61510b052a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1462601223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d87cae1-31fc-4694-8add-28838f68028b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91acdb7963874c87a0a062c81397b32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:34Z,use_quota=True,user_id='95ca91576b6a44af89312044e561dfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a75f4a-6bc4-48fe-ab72-d0429f3b165b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a75f4a-6bc4-48fe-ab72-d0429f3b165b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a616ff3-88c3-4ae4-a50e-7cc43d83879d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a616ff3-88c3-4ae4-a50e-7cc43d83879d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d87cae1-31fc-4694-8add-28838f68028b', 'volume_name': 'volume-6d87cae1-31fc-4694-8add-28838f68028b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f317622-1a13-4f9f-81be-68c2974ef306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f317622-1a13-4f9f-81be-68c2974ef306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04f7e97-6d9b-4f1a-a16a-f4c79f9d9151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Volume 6d87cae1-31fc-4694-8add-28838f68028b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d87cae1-31fc-4694-8add-28838f68028b', 'volume_size': 1} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1462601223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d87cae1-31fc-4694-8add-28838f68028b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91acdb7963874c87a0a062c81397b32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:34Z,use_quota=True,user_id='95ca91576b6a44af89312044e561dfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Creating volume 6d87cae1-31fc-4694-8add-28838f68028b {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:03:34 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:34 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b 1073741824 Jul 18 06:03:34 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:34 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b 1073741824" returned: 0 in 0.738s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:35 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b Jul 18 06:03:35 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:35 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:03:35 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:35 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b" returned: 0 in 0.490s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04f7e97-6d9b-4f1a-a16a-f4c79f9d9151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d87cae1-31fc-4694-8add-28838f68028b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba70183-1cbc-4e05-ac78-2cd9f1d9d276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:35 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Volume volume-6d87cae1-31fc-4694-8add-28838f68028b (6d87cae1-31fc-4694-8add-28838f68028b): created successfully Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba70183-1cbc-4e05-ac78-2cd9f1d9d276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:35 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Flow 'volume_create_manager' (a7896680-5918-49b9-aae6-3726c9636835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.464s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:03:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:03:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-44aca815-a2f0-46a8-ae4e-aa1ea135cfc0 tempest-VolumesSnapshotTestJSON-894130153 None] Created volume successfully. Jul 18 06:03:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] Creating offline snapshot 590f46c3-3678-41ee-8ec8-fe243646a9af of volume 6d87cae1-31fc-4694-8add-28838f68028b {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:03:36 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbd31e4-cb6b-468b-bcac-a630ac972b66]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:36 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b Jul 18 06:03:36 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:36 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b" returned: 0 in 0.390s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:36 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af 1G Jul 18 06:03:36 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:37 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af 1G" returned: 0 in 0.478s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d87cae1-31fc-4694-8add-28838f68028b -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:37 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d87cae1-31fc-4694-8add-28838f68028b -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af Jul 18 06:03:37 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:37 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d87cae1-31fc-4694-8add-28838f68028b -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af" returned: 0 in 0.315s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:37 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af is being set with open permissions: ugo+rw Jul 18 06:03:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:37 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af Jul 18 06:03:37 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "cinder-4f36b305-3808-4447-8d03-fbad94430d20-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Lock "cinder-4f36b305-3808-4447-8d03-fbad94430d20-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "cinder-quobyte-4f36b305-3808-4447-8d03-fbad94430d20" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Lock "cinder-quobyte-4f36b305-3808-4447-8d03-fbad94430d20" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:37 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af" returned: 0 in 0.295s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:37 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7c41a9-7def-4901-aa21-08f38a62ecfa]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4f36b305-3808-4447-8d03-fbad94430d20 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:37 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.info Jul 18 06:03:37 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:37 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4f36b305-3808-4447-8d03-fbad94430d20 Jul 18 06:03:37 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:38 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.info" returned: 0 in 0.298s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:38 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.info is being set with open permissions: ugo+rw Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:38 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.info Jul 18 06:03:38 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:38 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4f36b305-3808-4447-8d03-fbad94430d20" returned: 0 in 0.410s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4f36b305-3808-4447-8d03-fbad94430d20 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:38 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4f36b305-3808-4447-8d03-fbad94430d20 Jul 18 06:03:38 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:38 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.info" returned: 0 in 0.280s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-746aad8a-7d58-4ccd-802a-480c2a92ce85 tempest-VolumesSnapshotTestJSON-894130153 None] Create snapshot completed successfully Jul 18 06:03:38 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4f36b305-3808-4447-8d03-fbad94430d20" returned: 0 in 0.277s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Lock "cinder-quobyte-4f36b305-3808-4447-8d03-fbad94430d20" released by "delete_volume" :: held 0.734s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Created reservations ['ff75ab7b-9ad1-4ea5-af33-430fb3841447', '1bdf19d1-4020-401c-ab80-97f71c294220', '6d79c40a-4f4a-4e5f-ae38-e6c29d18e2f2', '48b2990b-9e2b-4af4-9b0c-b4110a5673ad'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:38 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:03:38 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "cinder-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Lock "cinder-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:38 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.287s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:03:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Deleted volume successfully. Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "cinder-quobyte-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Lock "cinder-quobyte-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2c65e215-289e-41bb-bf13-7632745d26b4 tempest-AttachVolumeTestJSON-231829717 None] Lock "cinder-4f36b305-3808-4447-8d03-fbad94430d20-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d966df-e086-4183-a9d9-5b1192d1355d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:39 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1 Jul 18 06:03:39 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:39 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1" returned: 0 in 0.410s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:39 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1 Jul 18 06:03:39 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:39 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Lock "cinder-quobyte-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1" released by "delete_volume" :: held 0.712s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:39 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Created reservations ['684eb135-ba7e-44c2-bc8d-1e2b447990e7', 'c02f2f3e-4684-455e-9f9a-6d8f4b53b812', '064b2c22-e315-4068-be25-f9adff9d0c66', 'ed547f99-7fcd-4514-982a-d82bcd1881ce'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:39 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:03:39 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Flow 'volume_create_manager' (47c84512-a170-44c1-a5b0-19f59b871c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6652806d-785d-4a22-86f2-3fb1811d5aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6652806d-785d-4a22-86f2-3fb1811d5aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-970286444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab0ba0c-01b0-4baf-a38d-9b807aed05e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91acdb7963874c87a0a062c81397b32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=590f46c3-3678-41ee-8ec8-fe243646a9af,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:40Z,use_quota=True,user_id='95ca91576b6a44af89312044e561dfde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a863cef-9352-4b26-8627-24925c15a9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a863cef-9352-4b26-8627-24925c15a9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:40 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db2ec7e-0738-4b1d-b6bd-58302145aedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db2ec7e-0738-4b1d-b6bd-58302145aedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cab0ba0c-01b0-4baf-a38d-9b807aed05e4', 'volume_name': 'volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4', 'volume_size': 1, 'snapshot_id': '590f46c3-3678-41ee-8ec8-fe243646a9af'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154bddfa-6744-49fc-92c6-2657fc7a7029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154bddfa-6744-49fc-92c6-2657fc7a7029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c764da70-33de-4590-9fee-a4dd4d6ea1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Volume cab0ba0c-01b0-4baf-a38d-9b807aed05e4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4', 'volume_size': 1, 'snapshot_id': '590f46c3-3678-41ee-8ec8-fe243646a9af'} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.451s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:03:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Deleted volume successfully. Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "cinder-ef9586d6-c159-414f-a4df-56763023f6cd-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-590f46c3-3678-41ee-8ec8-fe243646a9af-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Lock "cinder-ef9586d6-c159-414f-a4df-56763023f6cd-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7f15be72-b084-46a8-b8eb-04e914e348b6 tempest-AttachVolumeTestJSON-231829717 None] Lock "cinder-014ebdd1-88bd-4b5b-b1b0-fb5a5e3b9fc1-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-590f46c3-3678-41ee-8ec8-fe243646a9af-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Creating volume cab0ba0c-01b0-4baf-a38d-9b807aed05e4 from snapshot 590f46c3-3678-41ee-8ec8-fe243646a9af {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] snapshot: 590f46c3-3678-41ee-8ec8-fe243646a9af, volume: cab0ba0c-01b0-4baf-a38d-9b807aed05e4, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "cinder-quobyte-ef9586d6-c159-414f-a4df-56763023f6cd" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38ac5cb-d4f2-419a-bc30-22ad46e3a369]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Lock "cinder-quobyte-ef9586d6-c159-414f-a4df-56763023f6cd" acquired by "delete_volume" :: waited 0.067s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[644b5b68-68ad-42a0-bfa4-ed42f6c5132f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ef9586d6-c159-414f-a4df-56763023f6cd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:40 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af Jul 18 06:03:40 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:40 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ef9586d6-c159-414f-a4df-56763023f6cd Jul 18 06:03:40 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:40 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af" returned: 0 in 0.510s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d87cae1-31fc-4694-8add-28838f68028b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 06:03:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7837a35d-f027-4a98-b19b-e3fb05fdf9fc]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:41 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ef9586d6-c159-414f-a4df-56763023f6cd" returned: 0 in 0.514s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ef9586d6-c159-414f-a4df-56763023f6cd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:41 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ef9586d6-c159-414f-a4df-56763023f6cd Jul 18 06:03:41 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:41 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b Jul 18 06:03:41 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:41 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ef9586d6-c159-414f-a4df-56763023f6cd" returned: 0 in 0.324s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Lock "cinder-quobyte-ef9586d6-c159-414f-a4df-56763023f6cd" released by "delete_volume" :: held 0.884s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Created reservations ['d5e9244e-e7e8-4cb3-926c-208814c30539', 'e0f6822d-5c57-4005-bc2e-635e05658911', 'ae53679d-2aa7-41c1-a45e-89cb9a246a4f', '1c2aa17c-efab-4a79-b2d9-67e91c7f9571'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:41 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b" returned: 0 in 0.561s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Path /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:41 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:03:41 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:41 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4 Jul 18 06:03:41 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:41 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.388s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:03:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Deleted volume successfully. Jul 18 06:03:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-68f22d06-7f6c-4ead-94d9-eac6baa7d059 tempest-AttachVolumeTestJSON-231829717 None] Lock "cinder-ef9586d6-c159-414f-a4df-56763023f6cd-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:47 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" returned: 0 in 6.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e4c79e-75da-4d01-a9a3-6551c31b495a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:48 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b Jul 18 06:03:48 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:48 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b" returned: 0 in 0.905s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:48 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:03:48 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Converted 1024.00 MB image at 162.57 MB/s Jul 18 06:03:48 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4 is being set with open permissions: ugo+rw Jul 18 06:03:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:48 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4 Jul 18 06:03:48 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:49 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" returned: 0 in 0.531s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" released by "_copy_volume_from_snapshot" :: held 8.956s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-590f46c3-3678-41ee-8ec8-fe243646a9af-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" released by "_create_volume_from_snapshot" :: held 9.024s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.063s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c764da70-33de-4590-9fee-a4dd4d6ea1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4', 'volume_size': 1, 'snapshot_id': '590f46c3-3678-41ee-8ec8-fe243646a9af'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a618b771-2f41-46a0-8012-92b7b3e8be54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Volume volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4 (cab0ba0c-01b0-4baf-a38d-9b807aed05e4): created successfully Jul 18 06:03:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a618b771-2f41-46a0-8012-92b7b3e8be54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Flow 'volume_create_manager' (47c84512-a170-44c1-a5b0-19f59b871c22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-21e14f10-34d0-46ea-9b74-1194b358048e tempest-VolumesSnapshotTestJSON-894130153 None] Created volume successfully. Jul 18 06:03:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-cab0ba0c-01b0-4baf-a38d-9b807aed05e4-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-cab0ba0c-01b0-4baf-a38d-9b807aed05e4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d46bad-4910-4a98-a143-12b5c831726e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:50 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4 Jul 18 06:03:50 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:50 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" returned: 0 in 0.453s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:50 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4 Jul 18 06:03:50 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:51 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" returned: 0 in 0.443s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-cab0ba0c-01b0-4baf-a38d-9b807aed05e4" released by "delete_volume" :: held 0.964s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:51 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Created reservations ['42cf3f4c-6666-4420-b2ba-416818e0d300', '4d594e2a-454d-4789-9d29-47ded08bd364', 'e6a4892f-6b22-4d20-8279-4f17cb7fa0df', 'f57d1c13-f265-4c8a-aa24-150486f6d78b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:51 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:03:51 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:51 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.303s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:51 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:03:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Deleted volume successfully. Jul 18 06:03:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9536aad9-24d1-4c05-afba-c3ee35862f56 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-cab0ba0c-01b0-4baf-a38d-9b807aed05e4-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Flow 'volume_create_manager' (d588a0ea-ee2f-4e74-a2f3-454e0f2ca943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d711edb-b008-4935-8a64-35ef93700a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d711edb-b008-4935-8a64-35ef93700a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2050591373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540af9b2-709f-4ce8-a582-a881635631c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37974a170a9d4433be60c15bf748a7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:52Z,use_quota=True,user_id='b3daa710d4b644c6b8974a301f2dd75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593ce09f-db98-45a8-8f6d-e37c1bfee477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593ce09f-db98-45a8-8f6d-e37c1bfee477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8c025a-53ce-4bf7-9663-5506f922cf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8c025a-53ce-4bf7-9663-5506f922cf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '540af9b2-709f-4ce8-a582-a881635631c7', 'volume_name': 'volume-540af9b2-709f-4ce8-a582-a881635631c7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54914aee-2699-4a66-b032-4d4130af2bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54914aee-2699-4a66-b032-4d4130af2bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2973d10e-d137-4624-be72-4e0007788e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:52 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Volume 540af9b2-709f-4ce8-a582-a881635631c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-540af9b2-709f-4ce8-a582-a881635631c7', 'volume_size': 1} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2050591373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540af9b2-709f-4ce8-a582-a881635631c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37974a170a9d4433be60c15bf748a7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:52Z,use_quota=True,user_id='b3daa710d4b644c6b8974a301f2dd75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Creating volume 540af9b2-709f-4ce8-a582-a881635631c7 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:03:52 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-540af9b2-709f-4ce8-a582-a881635631c7 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:52 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-540af9b2-709f-4ce8-a582-a881635631c7 1073741824 Jul 18 06:03:52 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-590f46c3-3678-41ee-8ec8-fe243646a9af-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-590f46c3-3678-41ee-8ec8-fe243646a9af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-6d87cae1-31fc-4694-8add-28838f68028b" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-6d87cae1-31fc-4694-8add-28838f68028b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-590f46c3-3678-41ee-8ec8-fe243646a9af" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-590f46c3-3678-41ee-8ec8-fe243646a9af" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Deleting offline snapshot 590f46c3-3678-41ee-8ec8-fe243646a9af of volume 6d87cae1-31fc-4694-8add-28838f68028b {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] snapshot_file for this snap is: volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c95e371-3229-4af5-85f5-85ea2e963723]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:52 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:52 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af Jul 18 06:03:52 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-540af9b2-709f-4ce8-a582-a881635631c7 1073741824" returned: 0 in 0.601s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-a5feeacf-6799-44d6-8f08-9e0404000a52 req-13db8391-56f2-429c-9d01-b4e48ad4397b tempest-AttachVolumeNegativeTest-277769288 None] Terminate volume connection completed successfully. Jul 18 06:03:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-a5feeacf-6799-44d6-8f08-9e0404000a52 req-13db8391-56f2-429c-9d01-b4e48ad4397b tempest-AttachVolumeNegativeTest-277769288 None] Deleting attachment 2ab914c9-b393-4775-a711-1a83193e9079. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-540af9b2-709f-4ce8-a582-a881635631c7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:53 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-540af9b2-709f-4ce8-a582-a881635631c7 Jul 18 06:03:53 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:53 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af" returned: 0 in 0.537s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d87cae1-31fc-4694-8add-28838f68028b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:03:53 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-540af9b2-709f-4ce8-a582-a881635631c7" returned: 0 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8810949-703a-455b-8cc8-7f39c2bf0fbb]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2973d10e-d137-4624-be72-4e0007788e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-540af9b2-709f-4ce8-a582-a881635631c7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f6b1d3-3225-49c9-8be3-f4df33b01c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Volume volume-540af9b2-709f-4ce8-a582-a881635631c7 (540af9b2-709f-4ce8-a582-a881635631c7): created successfully Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f6b1d3-3225-49c9-8be3-f4df33b01c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Flow 'volume_create_manager' (d588a0ea-ee2f-4e74-a2f3-454e0f2ca943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d9615dc2-e2c5-4e10-8c81-655d087003a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Created volume successfully. Jul 18 06:03:53 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b Jul 18 06:03:53 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:53 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b" returned: 0 in 0.411s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:53 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af Jul 18 06:03:53 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:54 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af" returned: 0 in 0.460s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:54 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af Jul 18 06:03:54 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:54 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b.590f46c3-3678-41ee-8ec8-fe243646a9af" returned: 0 in 0.475s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Acquiring lock "cinder-540af9b2-709f-4ce8-a582-a881635631c7-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-590f46c3-3678-41ee-8ec8-fe243646a9af" released by "_delete_snapshot" :: held 2.084s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "cinder-540af9b2-709f-4ce8-a582-a881635631c7-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-6d87cae1-31fc-4694-8add-28838f68028b" released by "delete_snapshot" :: held 2.120s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Acquiring lock "cinder-quobyte-540af9b2-709f-4ce8-a582-a881635631c7" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "cinder-quobyte-540af9b2-709f-4ce8-a582-a881635631c7" acquired by "delete_volume" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[134bba79-c8f9-45f9-8fd6-2237f26277f6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-540af9b2-709f-4ce8-a582-a881635631c7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Created reservations ['6d5892eb-09a3-4677-9141-27537c66e1ce', '1de86d3a-55ac-47f4-9c74-2a3a36fd0d0e', '5526ce0e-8c70-454c-9aa8-a38bdfaa9b52', '28b6b35f-53e3-4297-8114-36e6e2c7c692'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:55 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Delete snapshot completed successfully. Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3819287-368d-45d3-a531-05c038fb2790 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-590f46c3-3678-41ee-8ec8-fe243646a9af-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:55 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-540af9b2-709f-4ce8-a582-a881635631c7 Jul 18 06:03:55 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:55 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-540af9b2-709f-4ce8-a582-a881635631c7" returned: 0 in 0.550s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-540af9b2-709f-4ce8-a582-a881635631c7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:55 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-540af9b2-709f-4ce8-a582-a881635631c7 Jul 18 06:03:55 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Flow 'volume_create_manager' (6e62106a-706e-4798-abd6-0e0907507570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2231aaa-fac0-477c-81fc-0ce95b3217a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2231aaa-fac0-477c-81fc-0ce95b3217a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-83252425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0862bea5-71fd-46f1-99e1-89bab6854f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfd08bb3a3b47b8bd29e3b5eb8debce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:56Z,use_quota=True,user_id='5bf5a07e256c444da9b361bc4a0bdee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b3cb63-c26f-4263-a4df-b05fab5717ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b3cb63-c26f-4263-a4df-b05fab5717ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbeb6c4-41bb-4605-9e85-a8f2337c8ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbeb6c4-41bb-4605-9e85-a8f2337c8ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0862bea5-71fd-46f1-99e1-89bab6854f0f', 'volume_name': 'volume-0862bea5-71fd-46f1-99e1-89bab6854f0f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ad064b-386c-43a6-92f1-3a6a46f86a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ad064b-386c-43a6-92f1-3a6a46f86a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5c10ea-09f9-48fa-bdae-f3e67a5e37d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:55 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Volume 0862bea5-71fd-46f1-99e1-89bab6854f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0862bea5-71fd-46f1-99e1-89bab6854f0f', 'volume_size': 1} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-83252425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0862bea5-71fd-46f1-99e1-89bab6854f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cfd08bb3a3b47b8bd29e3b5eb8debce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:56Z,use_quota=True,user_id='5bf5a07e256c444da9b361bc4a0bdee2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Creating volume 0862bea5-71fd-46f1-99e1-89bab6854f0f {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:03:55 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:55 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f 1073741824 Jul 18 06:03:55 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:55 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-540af9b2-709f-4ce8-a582-a881635631c7" returned: 0 in 0.352s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "cinder-quobyte-540af9b2-709f-4ce8-a582-a881635631c7" released by "delete_volume" :: held 0.961s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-6d87cae1-31fc-4694-8add-28838f68028b-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Created reservations ['baa2f004-00b3-47c1-9661-e535c0e3cbda', '26751173-a39b-439f-aaa9-3174717c13c3', 'e1c4415c-b4a4-4eea-823b-9810d8b10260', '3990fbba-9597-433c-9562-d24c41480158'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-6d87cae1-31fc-4694-8add-28838f68028b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-6d87cae1-31fc-4694-8add-28838f68028b" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-6d87cae1-31fc-4694-8add-28838f68028b" acquired by "delete_volume" :: waited 0.040s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e837d1e-8db0-49be-ba0e-4cc2652f3676]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:56 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:03:56 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:56 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b Jul 18 06:03:56 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:56 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f 1073741824" returned: 0 in 0.627s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:56 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.260s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Deleted volume successfully. Jul 18 06:03:56 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f Jul 18 06:03:56 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6210a170-ee11-43d8-9f6e-42a6389530a7 tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "cinder-540af9b2-709f-4ce8-a582-a881635631c7-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:56 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b" returned: 0 in 0.439s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:56 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b Jul 18 06:03:56 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:56 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f" returned: 0 in 0.304s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d5c10ea-09f9-48fa-bdae-f3e67a5e37d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0862bea5-71fd-46f1-99e1-89bab6854f0f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9901c7c-2458-41ec-ad99-12cd7ceb4ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:56 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Volume volume-0862bea5-71fd-46f1-99e1-89bab6854f0f (0862bea5-71fd-46f1-99e1-89bab6854f0f): created successfully Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9901c7c-2458-41ec-ad99-12cd7ceb4ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Flow 'volume_create_manager' (6e62106a-706e-4798-abd6-0e0907507570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-079bac7e-e0dc-4113-841e-ba53ce23022a req-1fd55dfb-cb49-4f80-9558-1872dfff7974 tempest-VolumesSnapshotsTestJSON-1067673132 None] Created volume successfully. Jul 18 06:03:56 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6d87cae1-31fc-4694-8add-28838f68028b" returned: 0 in 0.287s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-6d87cae1-31fc-4694-8add-28838f68028b" released by "delete_volume" :: held 0.810s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Created reservations ['afb0b503-85a7-4f27-8cfe-1889a34dfcc5', '7816437c-9965-42d4-8542-8d95165df173', '4b9538a5-b2f2-46ec-8d25-8af79d8b93b0', 'eb78fc10-f776-40bc-936f-779f5462b861'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:57 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:03:57 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-003813d4-dabb-4133-92f3-f821ae406b03-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-003813d4-dabb-4133-92f3-f821ae406b03-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "cinder-quobyte-003813d4-dabb-4133-92f3-f821ae406b03" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-003813d4-dabb-4133-92f3-f821ae406b03" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aad4ed-3f1d-4ce2-97e3-8ee3c19039fa]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:57 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.386s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:03:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Deleted volume successfully. Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf54ab71-7ab4-419e-a068-e38b8b23ff50 tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-6d87cae1-31fc-4694-8add-28838f68028b-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:57 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 Jul 18 06:03:57 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Flow 'volume_create_manager' (86aefa35-46c3-4ef8-be0c-949a33466d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1fe691-494b-46d6-a6a3-bc847770fe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1fe691-494b-46d6-a6a3-bc847770fe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-17361530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ced5eb-6655-4f74-82e6-0e0c471256c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37974a170a9d4433be60c15bf748a7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:58Z,use_quota=True,user_id='b3daa710d4b644c6b8974a301f2dd75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105ea37c-6035-44ae-b3f2-31ba53278f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105ea37c-6035-44ae-b3f2-31ba53278f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4bfeebc-312e-4141-a1dd-2294931259ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4bfeebc-312e-4141-a1dd-2294931259ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ced5eb-6655-4f74-82e6-0e0c471256c4', 'volume_name': 'volume-65ced5eb-6655-4f74-82e6-0e0c471256c4', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad88b1b-d023-4bf5-8ce0-414e816f6a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad88b1b-d023-4bf5-8ce0-414e816f6a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525a10d7-2dc1-4f79-ba49-c53986abf1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Volume 65ced5eb-6655-4f74-82e6-0e0c471256c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ced5eb-6655-4f74-82e6-0e0c471256c4', 'volume_size': 1} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-17361530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ced5eb-6655-4f74-82e6-0e0c471256c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37974a170a9d4433be60c15bf748a7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:03:58Z,use_quota=True,user_id='b3daa710d4b644c6b8974a301f2dd75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Creating volume 65ced5eb-6655-4f74-82e6-0e0c471256c4 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:03:57 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:03:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ced5eb-6655-4f74-82e6-0e0c471256c4 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:57 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ced5eb-6655-4f74-82e6-0e0c471256c4 1073741824 Jul 18 06:03:57 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:58 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03" returned: 0 in 0.517s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:58 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03 Jul 18 06:03:58 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:58 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-003813d4-dabb-4133-92f3-f821ae406b03" returned: 0 in 0.354s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-quobyte-003813d4-dabb-4133-92f3-f821ae406b03" released by "delete_volume" :: held 0.947s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Created reservations ['b39c8bd8-892f-4476-bd74-37b967f0f42f', '40534d09-bb1e-4b62-b12b-5b92d6ea3a04', 'a5f1cdaf-1433-486b-89b1-be8b5b11ad0b', '47fe2ec2-9e7c-4eee-baf9-46397c4bc916'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:58 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:03:58 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:58 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ced5eb-6655-4f74-82e6-0e0c471256c4 1073741824" returned: 0 in 0.635s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ced5eb-6655-4f74-82e6-0e0c471256c4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:58 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ced5eb-6655-4f74-82e6-0e0c471256c4 Jul 18 06:03:58 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:58 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.293s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:03:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Deleted volume successfully. Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=172,cinder:UPDATE=175,cinder:INSERT=48,cinder:DELETE=8 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5e167df3-c0d0-41a4-bb04-6b9dccd5c92a tempest-VolumesSnapshotTestJSON-894130153 None] Lock "cinder-003813d4-dabb-4133-92f3-f821ae406b03-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:03:58 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ced5eb-6655-4f74-82e6-0e0c471256c4" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.629s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (525a10d7-2dc1-4f79-ba49-c53986abf1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ced5eb-6655-4f74-82e6-0e0c471256c4', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3612421a-4038-49ab-97b8-7f690b104690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] Creating offline snapshot e45906f3-7ec9-4ea8-9176-80fd4e1022d2 of volume 0862bea5-71fd-46f1-99e1-89bab6854f0f {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:03:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Volume volume-65ced5eb-6655-4f74-82e6-0e0c471256c4 (65ced5eb-6655-4f74-82e6-0e0c471256c4): created successfully Jul 18 06:03:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3612421a-4038-49ab-97b8-7f690b104690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:03:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Flow 'volume_create_manager' (86aefa35-46c3-4ef8-be0c-949a33466d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:03:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5337ff2-64a1-4b52-8f42-c59b14d66f22]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:03:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a87cc695-feaf-48a3-9113-aa427138a3bc tempest-VolumeQuotasAdminTestJSON-806530747 None] Created volume successfully. Jul 18 06:03:59 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f Jul 18 06:03:59 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:59 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f" returned: 0 in 0.356s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:59 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 1G Jul 18 06:03:59 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:03:59 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Jul 18 06:03:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 1G" returned: 0 in 0.506s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:03:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0862bea5-71fd-46f1-99e1-89bab6854f0f -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:03:59 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0862bea5-71fd-46f1-99e1-89bab6854f0f -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 Jul 18 06:03:59 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:00 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0862bea5-71fd-46f1-99e1-89bab6854f0f -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2" returned: 0 in 0.364s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:00 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 is being set with open permissions: ugo+rw Jul 18 06:04:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:00 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 Jul 18 06:04:00 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:00 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2" returned: 0 in 0.324s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:00 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=184,cinder:SELECT=168,cinder:INSERT=39,cinder:DELETE=15 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:04:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:00 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.info Jul 18 06:04:00 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2343a8a4-bcae-4def-84d9-b365254fa205 tempest-VolumeQuotasAdminTestJSON-1986231527 None] Transfer volume completed successfully. Jul 18 06:04:00 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.info" returned: 0 in 0.355s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:00 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.info is being set with open permissions: ugo+rw Jul 18 06:04:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:01 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.info Jul 18 06:04:01 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:01 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.info" returned: 0 in 0.372s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-1be2f9e9-98b1-4f77-a39a-8db3739ef718 req-97da907f-589c-4595-a122-8dfd96b6c443 tempest-VolumesSnapshotsTestJSON-1067673132 None] Create snapshot completed successfully Jul 18 06:04:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Acquiring lock "cinder-65ced5eb-6655-4f74-82e6-0e0c471256c4-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Lock "cinder-65ced5eb-6655-4f74-82e6-0e0c471256c4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Acquiring lock "cinder-quobyte-65ced5eb-6655-4f74-82e6-0e0c471256c4" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Lock "cinder-quobyte-65ced5eb-6655-4f74-82e6-0e0c471256c4" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[89275c29-d69a-4bfc-8463-9386b2e4cea6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ced5eb-6655-4f74-82e6-0e0c471256c4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:01 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ced5eb-6655-4f74-82e6-0e0c471256c4 Jul 18 06:04:01 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Acquiring lock "cinder-e45906f3-7ec9-4ea8-9176-80fd4e1022d2-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "cinder-e45906f3-7ec9-4ea8-9176-80fd4e1022d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Acquiring lock "cinder-quobyte-0862bea5-71fd-46f1-99e1-89bab6854f0f" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "cinder-quobyte-0862bea5-71fd-46f1-99e1-89bab6854f0f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Acquiring lock "cinder-quobyte-e45906f3-7ec9-4ea8-9176-80fd4e1022d2" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "cinder-quobyte-e45906f3-7ec9-4ea8-9176-80fd4e1022d2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Deleting offline snapshot e45906f3-7ec9-4ea8-9176-80fd4e1022d2 of volume 0862bea5-71fd-46f1-99e1-89bab6854f0f {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] snapshot_file for this snap is: volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[874baddf-05c8-4946-a353-94dfc98cb2c6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:02 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ced5eb-6655-4f74-82e6-0e0c471256c4" returned: 0 in 0.537s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ced5eb-6655-4f74-82e6-0e0c471256c4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:02 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ced5eb-6655-4f74-82e6-0e0c471256c4 Jul 18 06:04:02 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:02 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 Jul 18 06:04:02 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:02 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ced5eb-6655-4f74-82e6-0e0c471256c4" returned: 0 in 0.353s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Lock "cinder-quobyte-65ced5eb-6655-4f74-82e6-0e0c471256c4" released by "delete_volume" :: held 0.939s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:02 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2" returned: 0 in 0.495s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0862bea5-71fd-46f1-99e1-89bab6854f0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9325bb9-3099-48be-80f4-8c0d8ff7af3a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Created reservations ['7de8b542-27a8-4d5b-a7da-fa15d1471294', '00e6c625-e599-459a-b290-b54229bbf1bf', '34bb14fc-441f-4d24-b694-c0eba96568f6', 'd0a0bf3f-b31b-4b6c-a902-4e28f8aca45d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:02 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f Jul 18 06:04:02 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:02 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:04:02 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:03 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.448s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:03 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:04:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Deleted volume successfully. Jul 18 06:04:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0139d57f-ac56-4e7b-b10d-b704101d3c12 tempest-VolumeQuotasAdminTestJSON-1076410811 None] Lock "cinder-65ced5eb-6655-4f74-82e6-0e0c471256c4-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:03 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f" returned: 0 in 0.659s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:03 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 Jul 18 06:04:03 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:03 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2" returned: 0 in 0.488s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:03 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2 Jul 18 06:04:03 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:04 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f.e45906f3-7ec9-4ea8-9176-80fd4e1022d2" returned: 0 in 0.522s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "cinder-quobyte-e45906f3-7ec9-4ea8-9176-80fd4e1022d2" released by "_delete_snapshot" :: held 2.373s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "cinder-quobyte-0862bea5-71fd-46f1-99e1-89bab6854f0f" released by "delete_snapshot" :: held 2.406s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:04 devstack cinder-volume[87750]: DEBUG cinder.quota [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Created reservations ['a4287f6d-5bea-4d6c-9094-c4232751dcef', '94d7494d-76ab-45c9-86e0-f85883d12e3a', '31931a3f-f436-4194-89e6-a7a8dea885b1', 'f32b2d32-3a1e-48c6-9ad4-ea3591112ee6'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Delete snapshot completed successfully. Jul 18 06:04:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-ae4f28c2-dbd1-43f1-b329-97f63fd43de3 req-fbab223c-d8a6-4d84-9d01-5ab3da2e8350 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "cinder-e45906f3-7ec9-4ea8-9176-80fd4e1022d2-delete_snapshot" released by "delete_snapshot" :: held 2.617s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Acquiring lock "cinder-0862bea5-71fd-46f1-99e1-89bab6854f0f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "cinder-0862bea5-71fd-46f1-99e1-89bab6854f0f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Acquiring lock "cinder-quobyte-0862bea5-71fd-46f1-99e1-89bab6854f0f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "cinder-quobyte-0862bea5-71fd-46f1-99e1-89bab6854f0f" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d495c3d7-1765-41d2-84ac-2831fefacee1]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:05 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f Jul 18 06:04:05 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:06 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f" returned: 0 in 0.536s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:06 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f Jul 18 06:04:06 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:06 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0862bea5-71fd-46f1-99e1-89bab6854f0f" returned: 0 in 0.680s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "cinder-quobyte-0862bea5-71fd-46f1-99e1-89bab6854f0f" released by "delete_volume" :: held 1.348s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:07 devstack cinder-volume[87750]: DEBUG cinder.quota [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Created reservations ['d2fb8e91-763c-477a-ac83-a89864699ffb', '7db3abce-921e-4769-9e33-13b107e5a706', '6668cfa3-e0f2-4b71-9eb6-56fab01aaf58', '466812f2-c675-4e2f-ac4a-0abcf0d8f969'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:04:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:04:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:07 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:04:07 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:07 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.561s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:07 devstack cinder-volume[87750]: DEBUG cinder.manager [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:04:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Deleted volume successfully. Jul 18 06:04:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-5abed194-61fc-4788-86d0-a512e9b73547 req-9c381589-e98b-48ff-8422-fbdac75a0a14 tempest-VolumesSnapshotsTestJSON-1067673132 None] Lock "cinder-0862bea5-71fd-46f1-99e1-89bab6854f0f-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Flow 'volume_create_manager' (7ec90556-f403-4566-9308-a77ddd3dec7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015b2d68-0293-443a-ad87-a39674674e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (015b2d68-0293-443a-ad87-a39674674e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-958112819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b56684-d3e7-402c-a61b-7a60c88dfdd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7626050a03b94376b015119fac74346e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:04:09Z,use_quota=True,user_id='47ffaa68c3d44f14b807f5ad6330bd4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8767db-8400-4d38-9723-587a3c427540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c8767db-8400-4d38-9723-587a3c427540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12182f0c-6981-4e25-9c77-4ca3dc6368ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12182f0c-6981-4e25-9c77-4ca3dc6368ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b56684-d3e7-402c-a61b-7a60c88dfdd6', 'volume_name': 'volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab931090-550f-48d6-8eda-a3a7915813ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab931090-550f-48d6-8eda-a3a7915813ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c45d3a-e823-440b-95be-d17c53ee6c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Volume a9b56684-d3e7-402c-a61b-7a60c88dfdd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6', 'volume_size': 1} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-958112819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b56684-d3e7-402c-a61b-7a60c88dfdd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7626050a03b94376b015119fac74346e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:04:09Z,use_quota=True,user_id='47ffaa68c3d44f14b807f5ad6330bd4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Creating volume a9b56684-d3e7-402c-a61b-7a60c88dfdd6 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:04:08 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:04:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:09 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 1073741824 Jul 18 06:04:09 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:09 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 1073741824" returned: 0 in 0.918s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:10 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 Jul 18 06:04:10 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:10 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" returned: 0 in 0.404s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:04:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c45d3a-e823-440b-95be-d17c53ee6c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cef9223-7513-4b4f-b6d7-91139255b8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:10 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Volume volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 (a9b56684-d3e7-402c-a61b-7a60c88dfdd6): created successfully Jul 18 06:04:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cef9223-7513-4b4f-b6d7-91139255b8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Flow 'volume_create_manager' (7ec90556-f403-4566-9308-a77ddd3dec7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:04:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8c86a1ce-582b-4a82-8ec6-8b8e2844056f tempest-VolumesSnapshotListTestJSON-308030165 None] Created volume successfully. Jul 18 06:04:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] Creating offline snapshot 26a7322a-18ef-4321-8f0a-a533117473a5 of volume a9b56684-d3e7-402c-a61b-7a60c88dfdd6 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:04:11 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2698c0-8182-41d4-a198-9c49f0bbba4e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:11 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 Jul 18 06:04:11 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:11 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" returned: 0 in 0.548s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:11 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 1G Jul 18 06:04:11 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:12 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 1G" returned: 0 in 0.639s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:12 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 Jul 18 06:04:12 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:13 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5" returned: 0 in 0.534s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:13 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 is being set with open permissions: ugo+rw Jul 18 06:04:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:13 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 Jul 18 06:04:13 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:13 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5" returned: 0 in 0.323s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:13 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.info Jul 18 06:04:13 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:13 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.info" returned: 0 in 0.324s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:13 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.info is being set with open permissions: ugo+rw Jul 18 06:04:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:13 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.info Jul 18 06:04:13 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:14 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.info" returned: 0 in 0.325s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.852s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f36d7642-f175-4de7-b66c-6b03d72be59d tempest-VolumesSnapshotListTestJSON-308030165 None] Create snapshot completed successfully Jul 18 06:04:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] Creating offline snapshot 43a84477-b75e-419a-8b59-d46a42c4fbc5 of volume a9b56684-d3e7-402c-a61b-7a60c88dfdd6 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:04:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2f6ab3-6fca-4fba-b8f2-b37c1eb2fabe]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:15 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 Jul 18 06:04:15 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:15 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5" returned: 0 in 0.472s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:04:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:15 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 1G Jul 18 06:04:15 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-57d4cb33-e4ea-4476-a344-2327e55a7f96 tempest-GroupSnapshotsV319Test-1006413872 None] Group tempest-GroupSnapshotsV319Test-Group-1516615119: creating Jul 18 06:04:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-57d4cb33-e4ea-4476-a344-2327e55a7f96 tempest-GroupSnapshotsV319Test-1006413872 None] Group tempest-GroupSnapshotsV319Test-Group-1516615119: created successfully Jul 18 06:04:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-57d4cb33-e4ea-4476-a344-2327e55a7f96 tempest-GroupSnapshotsV319Test-1006413872 None] Create group completed successfully. Jul 18 06:04:15 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 1G" returned: 0 in 0.550s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:15 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 Jul 18 06:04:15 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:16 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5" returned: 0 in 0.309s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:16 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 is being set with open permissions: ugo+rw Jul 18 06:04:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:16 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 Jul 18 06:04:16 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:16 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5" returned: 0 in 0.272s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.719s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f779a5bd-425d-4cb8-9bbd-22656a8a0aba tempest-VolumesSnapshotListTestJSON-308030165 None] Create snapshot completed successfully Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Flow 'volume_create_manager' (730fe01c-0ba1-49ec-856c-506d8ff62837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ce4a8b-7ad0-4960-9973-58e66ee1c66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] Creating offline snapshot f1afee73-6dfe-4ffc-8234-1317dd2ed3dc of volume a9b56684-d3e7-402c-a61b-7a60c88dfdd6 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ce4a8b-7ad0-4960-9973-58e66ee1c66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892113580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e818899d-66b7-4e13-987b-ba8245ae26ec,host='devstack@QuobyteHD#QuobyteHD',id=2abd0312-1b9a-404f-88f8-0ac455421f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54426dc9c7224df0a1075931689cb3c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:04:17Z,use_quota=True,user_id='08ec79bf33eb4b6cb3553a9bba779a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295f8e50-5f75-46be-8a11-93eaa85dba41),volume_type_id=295f8e50-5f75-46be-8a11-93eaa85dba41)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ad13fc-9c96-49dd-bd28-5ca9927bccef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ad13fc-9c96-49dd-bd28-5ca9927bccef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b04ea0-48ef-4334-a2cc-7a8cd24166dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b04ea0-48ef-4334-a2cc-7a8cd24166dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2abd0312-1b9a-404f-88f8-0ac455421f8c', 'volume_name': 'volume-2abd0312-1b9a-404f-88f8-0ac455421f8c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a19dd0a-0e79-4727-a9fc-2b651ef1028f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a19dd0a-0e79-4727-a9fc-2b651ef1028f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d5d19d-69fd-4236-bdf1-47effd0a59cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:17 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Volume 2abd0312-1b9a-404f-88f8-0ac455421f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2abd0312-1b9a-404f-88f8-0ac455421f8c', 'volume_size': 1} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[02862c40-bde0-435f-88c1-d33f3d01aebe]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:17 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 Jul 18 06:04:17 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:18 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5" returned: 0 in 0.424s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:04:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:18 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc 1G Jul 18 06:04:18 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:18 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc 1G" returned: 0 in 0.567s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:18 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc Jul 18 06:04:18 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:19 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc" returned: 0 in 0.312s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:19 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc is being set with open permissions: ugo+rw Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:19 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc Jul 18 06:04:19 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:19 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc" returned: 0 in 0.271s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.730s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.628s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e818899d-66b7-4e13-987b-ba8245ae26ec,created_at=2026-07-18T04:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892113580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e818899d-66b7-4e13-987b-ba8245ae26ec,host='devstack@QuobyteHD#QuobyteHD',id=2abd0312-1b9a-404f-88f8-0ac455421f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54426dc9c7224df0a1075931689cb3c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:04:17Z,use_quota=True,user_id='08ec79bf33eb4b6cb3553a9bba779a29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(295f8e50-5f75-46be-8a11-93eaa85dba41),volume_type_id=295f8e50-5f75-46be-8a11-93eaa85dba41)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Creating volume 2abd0312-1b9a-404f-88f8-0ac455421f8c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:04:19 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:19 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c 1073741824 Jul 18 06:04:19 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d5bd9003-04d4-4ed2-af1e-995666f2f302 tempest-VolumesSnapshotListTestJSON-308030165 None] Create snapshot completed successfully Jul 18 06:04:19 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c 1073741824" returned: 0 in 0.471s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:19 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c Jul 18 06:04:19 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:20 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:04:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d5d19d-69fd-4236-bdf1-47effd0a59cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2abd0312-1b9a-404f-88f8-0ac455421f8c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9756faed-3e74-4ba4-9a68-43cb5a1eaace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Volume volume-2abd0312-1b9a-404f-88f8-0ac455421f8c (2abd0312-1b9a-404f-88f8-0ac455421f8c): created successfully Jul 18 06:04:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9756faed-3e74-4ba4-9a68-43cb5a1eaace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Flow 'volume_create_manager' (730fe01c-0ba1-49ec-856c-506d8ff62837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:04:20 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-99ed557d-d4e0-43b2-8f52-e4d2d792e8d1 tempest-GroupSnapshotsV319Test-1006413872 None] Created volume successfully. Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "cinder-f1afee73-6dfe-4ffc-8234-1317dd2ed3dc-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-f1afee73-6dfe-4ffc-8234-1317dd2ed3dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "cinder-quobyte-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] GroupSnapshot 233469d7-5aa2-471b-a281-148bb0eeee8c: creating. Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "cinder-quobyte-f1afee73-6dfe-4ffc-8234-1317dd2ed3dc" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] Group snapshot 233469d7-5aa2-471b-a281-148bb0eeee8c: creating. {{(pid=87750) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-f1afee73-6dfe-4ffc-8234-1317dd2ed3dc" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Deleting offline snapshot f1afee73-6dfe-4ffc-8234-1317dd2ed3dc of volume a9b56684-d3e7-402c-a61b-7a60c88dfdd6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] snapshot_file for this snap is: volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] Creating offline snapshot 40829230-4a1e-4db3-81b1-440d635ebae4 of volume 2abd0312-1b9a-404f-88f8-0ac455421f8c {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[243e9786-c6f5-44c3-80ec-450bbc4f9e36]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e262167-02a2-4fbb-b4c2-2706bb3fbdb2]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:21 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc Jul 18 06:04:21 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:21 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c Jul 18 06:04:21 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:21 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc" returned: 0 in 0.391s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:04:21 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c" returned: 0 in 0.394s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ab6214-e831-4d74-857c-13dabd46b8d6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:21 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 1G Jul 18 06:04:21 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:21 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 Jul 18 06:04:21 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:22 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5" returned: 0 in 0.413s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:04:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:22 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 1G" returned: 0 in 0.457s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2abd0312-1b9a-404f-88f8-0ac455421f8c -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:22 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc Jul 18 06:04:22 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:22 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2abd0312-1b9a-404f-88f8-0ac455421f8c -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 Jul 18 06:04:22 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:22 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2abd0312-1b9a-404f-88f8-0ac455421f8c -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4" returned: 0 in 0.368s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:22 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:04:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:22 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 Jul 18 06:04:22 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:22 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc" returned: 0 in 0.507s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:22 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc Jul 18 06:04:22 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:22 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4" returned: 0 in 0.262s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:22 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.info Jul 18 06:04:22 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:22 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.f1afee73-6dfe-4ffc-8234-1317dd2ed3dc" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-f1afee73-6dfe-4ffc-8234-1317dd2ed3dc" released by "_delete_snapshot" :: held 1.713s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" released by "delete_snapshot" :: held 1.748s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Created reservations ['d4903129-0df0-43a7-a950-b834b7f8cf3b', 'f67ff894-0ae1-44ff-9d50-8c51c1309d04', '5ca05041-116b-404d-8c9c-86451bfb4161', 'cbe6bd0c-eb02-4198-9e43-8a5f05148c59'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Delete snapshot completed successfully. Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a9d022ea-3162-4087-a125-bf304588608d tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-f1afee73-6dfe-4ffc-8234-1317dd2ed3dc-delete_snapshot" released by "delete_snapshot" :: held 1.938s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:23 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.info" returned: 0 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:23 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:23 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.info Jul 18 06:04:23 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "cinder-43a84477-b75e-419a-8b59-d46a42c4fbc5-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-43a84477-b75e-419a-8b59-d46a42c4fbc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "cinder-quobyte-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:23 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.info" returned: 0 in 0.262s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.185s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "cinder-quobyte-43a84477-b75e-419a-8b59-d46a42c4fbc5" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-43a84477-b75e-419a-8b59-d46a42c4fbc5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Deleting offline snapshot 43a84477-b75e-419a-8b59-d46a42c4fbc5 of volume a9b56684-d3e7-402c-a61b-7a60c88dfdd6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] snapshot_file for this snap is: volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b712b7-d9f6-48ca-835b-ec2dde48bf68]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f9066066-bf50-4edb-be3d-d791e3241e5f tempest-GroupSnapshotsV319Test-1006413872 None] group_snapshot 233469d7-5aa2-471b-a281-148bb0eeee8c: created successfully Jul 18 06:04:23 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 Jul 18 06:04:23 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:23 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5" returned: 0 in 0.398s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f46239d-ef15-4614-992c-a9c9f2df93b5]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:24 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 Jul 18 06:04:24 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:24 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5" returned: 0 in 0.373s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:04:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:24 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 Jul 18 06:04:24 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:24 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5" returned: 0 in 0.439s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:24 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5 Jul 18 06:04:24 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] group_snapshot 233469d7-5aa2-471b-a281-148bb0eeee8c: deleting Jul 18 06:04:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] group_snapshot 233469d7-5aa2-471b-a281-148bb0eeee8c: deleting {{(pid=87750) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 18 06:04:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Acquiring lock "cinder-quobyte-2abd0312-1b9a-404f-88f8-0ac455421f8c" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Lock "cinder-quobyte-2abd0312-1b9a-404f-88f8-0ac455421f8c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Acquiring lock "cinder-quobyte-40829230-4a1e-4db3-81b1-440d635ebae4" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Lock "cinder-quobyte-40829230-4a1e-4db3-81b1-440d635ebae4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Deleting offline snapshot 40829230-4a1e-4db3-81b1-440d635ebae4 of volume 2abd0312-1b9a-404f-88f8-0ac455421f8c {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] snapshot_file for this snap is: volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a88e54-bcc5-4d79-82d2-beb42265ce80]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:25 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.43a84477-b75e-419a-8b59-d46a42c4fbc5" returned: 0 in 0.300s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-43a84477-b75e-419a-8b59-d46a42c4fbc5" released by "_delete_snapshot" :: held 1.646s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" released by "delete_snapshot" :: held 1.678s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:25 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 Jul 18 06:04:25 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Created reservations ['fabc7724-ceda-426e-9fcd-19d2ba990e0c', 'b38ec7bd-3ada-43c9-9340-d96bdc9a101d', 'dc99633f-1e32-44fb-8ba8-62c11ddc6a08', '1f22f353-e125-400d-aad0-f67edecadac9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Delete snapshot completed successfully. Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a0fdde7-6985-4e22-9bb1-98bf33e7c1e4 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-43a84477-b75e-419a-8b59-d46a42c4fbc5-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:25 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4" returned: 0 in 0.422s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2abd0312-1b9a-404f-88f8-0ac455421f8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7e57a6-7ce7-46d2-a147-21b810c493b9]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "cinder-26a7322a-18ef-4321-8f0a-a533117473a5-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-26a7322a-18ef-4321-8f0a-a533117473a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "cinder-quobyte-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "cinder-quobyte-26a7322a-18ef-4321-8f0a-a533117473a5" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-26a7322a-18ef-4321-8f0a-a533117473a5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Deleting offline snapshot 26a7322a-18ef-4321-8f0a-a533117473a5 of volume a9b56684-d3e7-402c-a61b-7a60c88dfdd6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:04:25 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c Jul 18 06:04:25 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] snapshot_file for this snap is: volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[930fb5ea-e983-4539-b925-d64b47370318]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:25 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 Jul 18 06:04:25 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:25 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c" returned: 0 in 0.422s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:25 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 Jul 18 06:04:25 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:26 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5" returned: 0 in 0.386s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[127fa591-6ee2-4b5d-b778-f4a19689fd61]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:26 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 Jul 18 06:04:26 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:26 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4" returned: 0 in 0.406s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:26 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4 Jul 18 06:04:26 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:26 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" returned: 0 in 0.420s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:26 devstack sudo[96174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 Jul 18 06:04:26 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:26 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c.40829230-4a1e-4db3-81b1-440d635ebae4" returned: 0 in 0.271s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Lock "cinder-quobyte-40829230-4a1e-4db3-81b1-440d635ebae4" released by "_delete_snapshot" :: held 1.658s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Lock "cinder-quobyte-2abd0312-1b9a-404f-88f8-0ac455421f8c" released by "delete_snapshot" :: held 1.682s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:26 devstack cinder-volume[87750]: WARNING cinder.quota [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1970142644 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1970142644, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:04:26 devstack cinder-volume[87750]: WARNING cinder.quota [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1970142644 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1970142644, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] Created reservations ['e9531d9f-386d-4e51-ab20-aee2604efcf0', '532e04bf-1496-4dc1-acba-9f3ff9f1c4ed', '2135a8ba-b13f-4bf8-8610-16cdd225ea57', '5edba94e-5308-43c2-9b26-3e49fd30ea73'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-eee94dd1-a2e9-4de5-8ba3-8e3c185348ca tempest-GroupSnapshotsV319Test-1006413872 None] group_snapshot 233469d7-5aa2-471b-a281-148bb0eeee8c: deleted successfully Jul 18 06:04:26 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5" returned: 0 in 0.407s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:26 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5 Jul 18 06:04:26 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:27 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6.26a7322a-18ef-4321-8f0a-a533117473a5" returned: 0 in 0.245s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-26a7322a-18ef-4321-8f0a-a533117473a5" released by "_delete_snapshot" :: held 1.578s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" released by "delete_snapshot" :: held 1.608s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Created reservations ['c8300ecb-2da7-4bac-a7c5-b421a22d3f42', '903f34d0-4246-4d93-a4d9-94202743c6f3', 'db296b5a-ee44-45ab-80c4-9415da64bf06', '70ad5291-5c0d-4c10-a155-a57bef680332'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:27 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Delete snapshot completed successfully. Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0bd8d3f7-2e90-42c1-bd00-84810e6b533a tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-26a7322a-18ef-4321-8f0a-a533117473a5-delete_snapshot" released by "delete_snapshot" :: held 1.799s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Acquiring lock "cinder-quobyte-2abd0312-1b9a-404f-88f8-0ac455421f8c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Lock "cinder-quobyte-2abd0312-1b9a-404f-88f8-0ac455421f8c" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[69530239-138a-4197-9fa2-afd84cd917fe]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:27 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c Jul 18 06:04:27 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "cinder-a9b56684-d3e7-402c-a61b-7a60c88dfdd6-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-a9b56684-d3e7-402c-a61b-7a60c88dfdd6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "cinder-quobyte-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[776e5bfe-8449-444f-a5b3-0c2b138e25d2]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:28 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 Jul 18 06:04:28 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:28 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c" returned: 0 in 0.547s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:28 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c Jul 18 06:04:28 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:28 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2abd0312-1b9a-404f-88f8-0ac455421f8c" returned: 0 in 0.306s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:28 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Lock "cinder-quobyte-2abd0312-1b9a-404f-88f8-0ac455421f8c" released by "delete_volume" :: held 0.941s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" returned: 0 in 0.560s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:28 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6 Jul 18 06:04:28 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Created reservations ['bdc43fcc-8bc1-4e7a-a396-e0bd1807b973'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:28 devstack cinder-volume[87750]: WARNING cinder.quota [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1970142644 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1970142644, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Created reservations ['66f736e1-7822-46f6-aade-bd4ff21c1565', '8859b30e-3096-4836-98a5-5c8d1f8c406f', '74d5ded1-3c0b-4c23-b598-eb32fe8dbe5c', '0d6ca438-dbd6-40d5-ad63-5ffcb17f3314'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:28 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:04:28 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:28 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" returned: 0 in 0.435s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-quobyte-a9b56684-d3e7-402c-a61b-7a60c88dfdd6" released by "delete_volume" :: held 1.099s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Created reservations ['63d280e4-c4d5-4580-8f90-2d9e4a4be21e', 'a0515fbc-d705-40f3-bbde-39097cb07dae', 'e0206a6d-3e2f-4c6a-81d7-910ee0e0915f', 'b538f4a6-1355-417a-9f1c-fd6dfb79a367'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:29 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:04:29 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:29 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.377s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:04:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fdea6f53-f561-4b55-ab86-8615e60a0703 tempest-GroupSnapshotsV319Test-1006413872 None] Delete group completed successfully. Jul 18 06:04:29 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:04:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Deleted volume successfully. Jul 18 06:04:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-aa9e8cdb-8750-41fa-a6ba-328cea6aeea5 tempest-VolumesSnapshotListTestJSON-308030165 None] Lock "cinder-a9b56684-d3e7-402c-a61b-7a60c88dfdd6-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Flow 'volume_create_manager' (4c2e4abf-754b-4da9-a0e9-a91961fb48a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67319b1-41ef-4718-9467-b58c1b693efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67319b1-41ef-4718-9467-b58c1b693efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1851275417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd6c7a4f1dd4619b18aee06fb68a7d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:04:33Z,use_quota=True,user_id='f955832c646e4e50aa7cdfb4e8bf2b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562ddbaf-d52e-4a47-89df-5d6fd6d15ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (562ddbaf-d52e-4a47-89df-5d6fd6d15ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b840505f-cfb4-4e4d-8ffa-e6ed8cfc76bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b840505f-cfb4-4e4d-8ffa-e6ed8cfc76bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364', 'volume_name': 'volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5939d4-4b9b-4a56-a77b-f44482067de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5939d4-4b9b-4a56-a77b-f44482067de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41d451d-d8ed-4fe6-bd68-4cf7324609e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:32 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Volume 61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364', 'volume_size': 1} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1851275417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd6c7a4f1dd4619b18aee06fb68a7d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:04:33Z,use_quota=True,user_id='f955832c646e4e50aa7cdfb4e8bf2b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Creating volume 61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:04:32 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:04:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:32 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364 1073741824 Jul 18 06:04:32 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:33 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364 1073741824" returned: 0 in 0.643s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:33 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364 Jul 18 06:04:33 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:33 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364" returned: 0 in 0.282s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:04:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41d451d-d8ed-4fe6-bd68-4cf7324609e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0f794f-b6b7-4aec-816a-b0f3bafdacdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:33 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Volume volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364 (61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364): created successfully Jul 18 06:04:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e0f794f-b6b7-4aec-816a-b0f3bafdacdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Flow 'volume_create_manager' (4c2e4abf-754b-4da9-a0e9-a91961fb48a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:04:33 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-65f79f6e-cbf2-4a8c-aa96-00d2c7b292e6 tempest-AttachVolumeNegativeTest-277769288 None] Created volume successfully. Jul 18 06:04:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:04:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:04:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:04:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:35 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:04:35 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:35 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:04:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:04:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:04:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:04:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-42d26245-5768-4165-b480-3d1636050eb9 req-1472f210-9a93-4f6e-8a2b-dd8139ee6a61 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-42d26245-5768-4165-b480-3d1636050eb9 req-1472f210-9a93-4f6e-8a2b-dd8139ee6a61 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-42d26245-5768-4165-b480-3d1636050eb9 req-1472f210-9a93-4f6e-8a2b-dd8139ee6a61 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-42d26245-5768-4165-b480-3d1636050eb9 req-1472f210-9a93-4f6e-8a2b-dd8139ee6a61 tempest-AttachVolumeNegativeTest-277769288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd35b1b59-94e0-4cdc-b504-0bf94327beb4', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:04:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-42d26245-5768-4165-b480-3d1636050eb9 req-1472f210-9a93-4f6e-8a2b-dd8139ee6a61 tempest-AttachVolumeNegativeTest-277769288 None] attachment_update completed successfully. Jul 18 06:04:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-c9228ee8-9858-4549-b9fe-a348821d4349 req-a0e1ff47-900e-417a-a97f-fa2d71db5fd7 tempest-AttachVolumeNegativeTest-277769288 None] Terminate volume connection completed successfully. Jul 18 06:04:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-c9228ee8-9858-4549-b9fe-a348821d4349 req-a0e1ff47-900e-417a-a97f-fa2d71db5fd7 tempest-AttachVolumeNegativeTest-277769288 None] Deleting attachment d35b1b59-94e0-4cdc-b504-0bf94327beb4. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:04:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-578744e0-adbe-47d7-91b1-aa5051f89bcd tempest-GroupsTest-1417880269 None] Group tempest-Group1-1139292691: creating Jul 18 06:04:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-578744e0-adbe-47d7-91b1-aa5051f89bcd tempest-GroupsTest-1417880269 None] Group tempest-Group1-1139292691: created successfully Jul 18 06:04:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-578744e0-adbe-47d7-91b1-aa5051f89bcd tempest-GroupsTest-1417880269 None] Create group completed successfully. Jul 18 06:04:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-de2c7555-73dd-4ae9-a183-8d63da848cad tempest-GroupsTest-1417880269 None] Group tempest-Group2-224462733: creating Jul 18 06:04:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-de2c7555-73dd-4ae9-a183-8d63da848cad tempest-GroupsTest-1417880269 None] Group tempest-Group2-224462733: created successfully Jul 18 06:04:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-de2c7555-73dd-4ae9-a183-8d63da848cad tempest-GroupsTest-1417880269 None] Create group completed successfully. Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Flow 'volume_create_manager' (686cc22d-2230-49fb-bfee-887dd8331cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a287b1da-8cf9-45c6-994e-b365432ea887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a287b1da-8cf9-45c6-994e-b365432ea887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-630621521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0404950f-ae08-4647-b5aa-d13787c3640e,host='devstack@QuobyteHD#QuobyteHD',id=9c40ae5e-81cd-4adc-aebe-93e37c5103d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f09385404b4399b610962250e09f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:04:54Z,use_quota=True,user_id='d63d397e25ec47d097501942b2f74f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39718586-8937-49e8-9919-9028dd6682d5),volume_type_id=39718586-8937-49e8-9919-9028dd6682d5)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d911fa5-b2dd-4eba-8993-4a5d83cf5a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d911fa5-b2dd-4eba-8993-4a5d83cf5a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9851f3e6-88ee-42bb-bd31-f6bed039d980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9851f3e6-88ee-42bb-bd31-f6bed039d980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c40ae5e-81cd-4adc-aebe-93e37c5103d3', 'volume_name': 'volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ad46d5-e7f3-40e9-93ea-ec03d3951d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ad46d5-e7f3-40e9-93ea-ec03d3951d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3674a05f-6e76-4e41-b0ee-fe80c3633150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Volume 9c40ae5e-81cd-4adc-aebe-93e37c5103d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3', 'volume_size': 1} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0404950f-ae08-4647-b5aa-d13787c3640e,created_at=2026-07-18T04:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-630621521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0404950f-ae08-4647-b5aa-d13787c3640e,host='devstack@QuobyteHD#QuobyteHD',id=9c40ae5e-81cd-4adc-aebe-93e37c5103d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f09385404b4399b610962250e09f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:04:54Z,use_quota=True,user_id='d63d397e25ec47d097501942b2f74f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39718586-8937-49e8-9919-9028dd6682d5),volume_type_id=39718586-8937-49e8-9919-9028dd6682d5)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Creating volume 9c40ae5e-81cd-4adc-aebe-93e37c5103d3 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:04:54 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:54 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3 1073741824 Jul 18 06:04:54 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:54 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3 1073741824" returned: 0 in 0.561s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:54 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3 Jul 18 06:04:54 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:55 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3" returned: 0 in 0.280s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:04:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3674a05f-6e76-4e41-b0ee-fe80c3633150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d424d3-f086-4b18-be88-aad5b748edcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:04:55 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Volume volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3 (9c40ae5e-81cd-4adc-aebe-93e37c5103d3): created successfully Jul 18 06:04:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d424d3-f086-4b18-be88-aad5b748edcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:04:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Flow 'volume_create_manager' (686cc22d-2230-49fb-bfee-887dd8331cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:04:55 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9ed558fe-aba6-411e-b579-af640453dae8 tempest-GroupsTest-1417880269 None] Created volume successfully. Jul 18 06:04:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Acquiring lock "cinder-quobyte-9c40ae5e-81cd-4adc-aebe-93e37c5103d3" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:04:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Lock "cinder-quobyte-9c40ae5e-81cd-4adc-aebe-93e37c5103d3" acquired by "delete_volume" :: waited 0.040s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:04:56 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[00837993-7712-4aad-b74b-4cdf3e7a7271]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:04:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:56 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3 Jul 18 06:04:56 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:56 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3" returned: 0 in 0.493s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:56 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3 Jul 18 06:04:56 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:56 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9c40ae5e-81cd-4adc-aebe-93e37c5103d3" returned: 0 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Lock "cinder-quobyte-9c40ae5e-81cd-4adc-aebe-93e37c5103d3" released by "delete_volume" :: held 0.881s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:04:56 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Created reservations ['443eff10-db96-4b24-8aa7-b70757d30e25'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:57 devstack cinder-volume[87750]: WARNING cinder.quota [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-915354784 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-915354784, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:04:57 devstack cinder-volume[87750]: WARNING cinder.quota [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-915354784 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-915354784, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:04:57 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Created reservations ['21d94948-f814-4f94-8fe4-a0182784518d', 'c491b455-ddbe-4b4f-9ea3-c3241b48ace7', '195f43e0-ff6d-4932-9b79-467488407d6c', 'e8b71ea4-5987-46a4-8b76-08f5bead4602'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:04:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:04:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:57 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:04:57 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:57 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.342s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:57 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:04:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-14c265a2-ad61-4be4-982a-f9112e263f92 tempest-GroupsTest-1417880269 None] Delete group completed successfully. Jul 18 06:04:58 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b9750c35-ceaa-412c-83b8-40f18a6c966e tempest-GroupsTest-1417880269 None] Created reservations ['ed208d16-2d4a-4947-9b20-88931f84a477'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:04:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9750c35-ceaa-412c-83b8-40f18a6c966e tempest-GroupsTest-1417880269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:04:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9750c35-ceaa-412c-83b8-40f18a6c966e tempest-GroupsTest-1417880269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:04:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9750c35-ceaa-412c-83b8-40f18a6c966e tempest-GroupsTest-1417880269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:04:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9750c35-ceaa-412c-83b8-40f18a6c966e tempest-GroupsTest-1417880269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:04:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9750c35-ceaa-412c-83b8-40f18a6c966e tempest-GroupsTest-1417880269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:04:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9750c35-ceaa-412c-83b8-40f18a6c966e tempest-GroupsTest-1417880269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:04:58 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:04:58 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:04:58 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 18 06:04:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9750c35-ceaa-412c-83b8-40f18a6c966e tempest-GroupsTest-1417880269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:04:58 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b9750c35-ceaa-412c-83b8-40f18a6c966e tempest-GroupsTest-1417880269 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:04:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b9750c35-ceaa-412c-83b8-40f18a6c966e tempest-GroupsTest-1417880269 None] Delete group completed successfully. Jul 18 06:05:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7825660a-67b6-4bec-86f6-79c71fdc07e2 tempest-GroupsTest-1417880269 None] Group tempest-GroupsTest-Group-2122080399: creating Jul 18 06:05:00 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=100,cinder:SELECT=99,cinder:INSERT=27,cinder:DELETE=7 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:05:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7825660a-67b6-4bec-86f6-79c71fdc07e2 tempest-GroupsTest-1417880269 None] Group tempest-GroupsTest-Group-2122080399: created successfully Jul 18 06:05:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7825660a-67b6-4bec-86f6-79c71fdc07e2 tempest-GroupsTest-1417880269 None] Create group completed successfully. Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Flow 'volume_create_manager' (efc31981-81d5-408e-9099-d7999624fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee097cd9-55e2-4666-9fd6-70e00d55bc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=107,cinder:UPDATE=103,cinder:INSERT=23,cinder:DELETE=4 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee097cd9-55e2-4666-9fd6-70e00d55bc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-268995610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=189dedc1-82d6-4c2b-a647-3532066e6a73,host='devstack@QuobyteHD#QuobyteHD',id=6963db8d-9529-44bd-ae28-1941686b4f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f09385404b4399b610962250e09f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:02Z,use_quota=True,user_id='d63d397e25ec47d097501942b2f74f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4811d9f1-5314-47f6-a0f0-0a44753fe32f),volume_type_id=4811d9f1-5314-47f6-a0f0-0a44753fe32f)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31417122-b49d-4459-a6c5-a39188b814c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31417122-b49d-4459-a6c5-a39188b814c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdb446a-abef-44e2-8d01-751aba79fec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdb446a-abef-44e2-8d01-751aba79fec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6963db8d-9529-44bd-ae28-1941686b4f63', 'volume_name': 'volume-6963db8d-9529-44bd-ae28-1941686b4f63', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cef79d9-0dea-44ec-8f64-64cce9068740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cef79d9-0dea-44ec-8f64-64cce9068740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d64a85-edfe-4294-a7cf-8e2080366e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:02 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Volume 6963db8d-9529-44bd-ae28-1941686b4f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6963db8d-9529-44bd-ae28-1941686b4f63', 'volume_size': 1} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=189dedc1-82d6-4c2b-a647-3532066e6a73,created_at=2026-07-18T04:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-268995610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=189dedc1-82d6-4c2b-a647-3532066e6a73,host='devstack@QuobyteHD#QuobyteHD',id=6963db8d-9529-44bd-ae28-1941686b4f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f09385404b4399b610962250e09f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:02Z,use_quota=True,user_id='d63d397e25ec47d097501942b2f74f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4811d9f1-5314-47f6-a0f0-0a44753fe32f),volume_type_id=4811d9f1-5314-47f6-a0f0-0a44753fe32f)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Creating volume 6963db8d-9529-44bd-ae28-1941686b4f63 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:05:02 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:05:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6963db8d-9529-44bd-ae28-1941686b4f63 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:02 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6963db8d-9529-44bd-ae28-1941686b4f63 1073741824 Jul 18 06:05:02 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:03 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6963db8d-9529-44bd-ae28-1941686b4f63 1073741824" returned: 0 in 0.923s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6963db8d-9529-44bd-ae28-1941686b4f63 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:03 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6963db8d-9529-44bd-ae28-1941686b4f63 Jul 18 06:05:03 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:03 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6963db8d-9529-44bd-ae28-1941686b4f63" returned: 0 in 0.436s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:05:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d64a85-edfe-4294-a7cf-8e2080366e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6963db8d-9529-44bd-ae28-1941686b4f63', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8c80be-6952-4da1-9323-e84ca8c05b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Volume volume-6963db8d-9529-44bd-ae28-1941686b4f63 (6963db8d-9529-44bd-ae28-1941686b4f63): created successfully Jul 18 06:05:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8c80be-6952-4da1-9323-e84ca8c05b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Flow 'volume_create_manager' (efc31981-81d5-408e-9099-d7999624fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c01d1627-35d5-43a4-badc-60a67d5ec0e5 tempest-GroupsTest-1417880269 None] Created volume successfully. Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Flow 'volume_create_manager' (ebb92452-041b-4fe5-9def-a88b01b26c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b39ce40-1f7e-47c7-9692-ae827823c70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b39ce40-1f7e-47c7-9692-ae827823c70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1514194304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=189dedc1-82d6-4c2b-a647-3532066e6a73,host='devstack@QuobyteHD#QuobyteHD',id=3e817c51-070c-426a-abd3-0333c4a7a520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f09385404b4399b610962250e09f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:05Z,use_quota=True,user_id='d63d397e25ec47d097501942b2f74f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4811d9f1-5314-47f6-a0f0-0a44753fe32f),volume_type_id=4811d9f1-5314-47f6-a0f0-0a44753fe32f)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c15792-6723-4b6c-bf8f-f27db2a4845c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c15792-6723-4b6c-bf8f-f27db2a4845c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05c39fb-60db-4ff3-a0c2-354268419605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05c39fb-60db-4ff3-a0c2-354268419605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e817c51-070c-426a-abd3-0333c4a7a520', 'volume_name': 'volume-3e817c51-070c-426a-abd3-0333c4a7a520', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f6bd0d-7a64-4223-b3ba-44b54bf5bbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f6bd0d-7a64-4223-b3ba-44b54bf5bbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d657ebe8-a649-4ffe-add8-bc4d92dcf0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:05 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Volume 3e817c51-070c-426a-abd3-0333c4a7a520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e817c51-070c-426a-abd3-0333c4a7a520', 'volume_size': 1} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=189dedc1-82d6-4c2b-a647-3532066e6a73,created_at=2026-07-18T04:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1514194304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=189dedc1-82d6-4c2b-a647-3532066e6a73,host='devstack@QuobyteHD#QuobyteHD',id=3e817c51-070c-426a-abd3-0333c4a7a520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f09385404b4399b610962250e09f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:05Z,use_quota=True,user_id='d63d397e25ec47d097501942b2f74f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4811d9f1-5314-47f6-a0f0-0a44753fe32f),volume_type_id=4811d9f1-5314-47f6-a0f0-0a44753fe32f)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Creating volume 3e817c51-070c-426a-abd3-0333c4a7a520 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:05:05 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:05:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3e817c51-070c-426a-abd3-0333c4a7a520 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:05 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3e817c51-070c-426a-abd3-0333c4a7a520 1073741824 Jul 18 06:05:05 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:06 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3e817c51-070c-426a-abd3-0333c4a7a520 1073741824" returned: 0 in 0.586s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3e817c51-070c-426a-abd3-0333c4a7a520 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:06 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3e817c51-070c-426a-abd3-0333c4a7a520 Jul 18 06:05:06 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:06 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3e817c51-070c-426a-abd3-0333c4a7a520" returned: 0 in 0.376s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:05:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d657ebe8-a649-4ffe-add8-bc4d92dcf0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e817c51-070c-426a-abd3-0333c4a7a520', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a6e305-dd88-4149-a894-b42f80e8b36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:06 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Volume volume-3e817c51-070c-426a-abd3-0333c4a7a520 (3e817c51-070c-426a-abd3-0333c4a7a520): created successfully Jul 18 06:05:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a6e305-dd88-4149-a894-b42f80e8b36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Flow 'volume_create_manager' (ebb92452-041b-4fe5-9def-a88b01b26c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-47f09a8c-a93c-4e13-a2fa-e812a8af6738 tempest-GroupsTest-1417880269 None] Created volume successfully. Jul 18 06:05:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a22bf72a-aabc-4a05-8db9-2b686e33c3ab tempest-GroupsTest-1417880269 None] Update group completed successfully. Jul 18 06:05:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5cbe9253-3318-43ee-ba2f-5b583b9168db tempest-GroupsTest-1417880269 None] Update group completed successfully. Jul 18 06:05:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Acquiring lock "cinder-quobyte-3e817c51-070c-426a-abd3-0333c4a7a520" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Lock "cinder-quobyte-3e817c51-070c-426a-abd3-0333c4a7a520" acquired by "delete_volume" :: waited 0.075s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:13 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[793135c5-6a7a-4c9d-aa7a-6f676874886e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3e817c51-070c-426a-abd3-0333c4a7a520 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:13 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3e817c51-070c-426a-abd3-0333c4a7a520 Jul 18 06:05:13 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:14 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3e817c51-070c-426a-abd3-0333c4a7a520" returned: 0 in 1.132s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3e817c51-070c-426a-abd3-0333c4a7a520 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:14 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3e817c51-070c-426a-abd3-0333c4a7a520 Jul 18 06:05:14 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Flow 'volume_create_manager' (66d1e07f-8001-4ce9-9352-d0c3ebdd5674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb781d2-6e76-4afd-9d6e-cbe4edd44d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb781d2-6e76-4afd-9d6e-cbe4edd44d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-61182184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a28f80-819e-4430-a650-324ab18c0547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e40f46975544118a4826060a8beadc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:14Z,use_quota=True,user_id='026174c00d3c4adcb6d0fe668ca17978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d633bb7-0638-4632-8951-a97a29747ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d633bb7-0638-4632-8951-a97a29747ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b149a7c-6727-4281-ae07-45f4f3e0fea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b149a7c-6727-4281-ae07-45f4f3e0fea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a28f80-819e-4430-a650-324ab18c0547', 'volume_name': 'volume-17a28f80-819e-4430-a650-324ab18c0547', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a40b18-bd04-46e0-a05a-f7c7d9855ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a40b18-bd04-46e0-a05a-f7c7d9855ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554a9b9f-390c-43db-a13c-1555cd577d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:14 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Volume 17a28f80-819e-4430-a650-324ab18c0547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a28f80-819e-4430-a650-324ab18c0547', 'volume_size': 1} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-61182184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a28f80-819e-4430-a650-324ab18c0547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e40f46975544118a4826060a8beadc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:14Z,use_quota=True,user_id='026174c00d3c4adcb6d0fe668ca17978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Creating volume 17a28f80-819e-4430-a650-324ab18c0547 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:05:14 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-17a28f80-819e-4430-a650-324ab18c0547 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:14 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-17a28f80-819e-4430-a650-324ab18c0547 1073741824 Jul 18 06:05:14 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:14 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3e817c51-070c-426a-abd3-0333c4a7a520" returned: 0 in 0.414s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Lock "cinder-quobyte-3e817c51-070c-426a-abd3-0333c4a7a520" released by "delete_volume" :: held 1.744s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Acquiring lock "cinder-quobyte-6963db8d-9529-44bd-ae28-1941686b4f63" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Lock "cinder-quobyte-6963db8d-9529-44bd-ae28-1941686b4f63" acquired by "delete_volume" :: waited 0.044s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1703afec-0d2e-4b2f-8e0a-5af772e297c3]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6963db8d-9529-44bd-ae28-1941686b4f63 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:15 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6963db8d-9529-44bd-ae28-1941686b4f63 Jul 18 06:05:15 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:15 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6963db8d-9529-44bd-ae28-1941686b4f63" returned: 0 in 0.824s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6963db8d-9529-44bd-ae28-1941686b4f63 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:15 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-17a28f80-819e-4430-a650-324ab18c0547 1073741824" returned: 0 in 1.126s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:15 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6963db8d-9529-44bd-ae28-1941686b4f63 Jul 18 06:05:15 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-17a28f80-819e-4430-a650-324ab18c0547 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:15 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-17a28f80-819e-4430-a650-324ab18c0547 Jul 18 06:05:15 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:16 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-17a28f80-819e-4430-a650-324ab18c0547" returned: 0 in 0.476s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:16 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6963db8d-9529-44bd-ae28-1941686b4f63" returned: 0 in 0.616s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554a9b9f-390c-43db-a13c-1555cd577d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a28f80-819e-4430-a650-324ab18c0547', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348ebbd5-5a1f-4fb6-887e-6e7234bb0536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Lock "cinder-quobyte-6963db8d-9529-44bd-ae28-1941686b4f63" released by "delete_volume" :: held 1.590s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Volume volume-17a28f80-819e-4430-a650-324ab18c0547 (17a28f80-819e-4430-a650-324ab18c0547): created successfully Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348ebbd5-5a1f-4fb6-887e-6e7234bb0536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Flow 'volume_create_manager' (66d1e07f-8001-4ce9-9352-d0c3ebdd5674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5a9335a1-92bb-4b9e-9a3a-7691c568b09a tempest-VolumesActionsTest-1764515551 None] Created volume successfully. Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Created reservations ['13443087-d0cb-45bb-ac00-eaa1d3941f43'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:16 devstack cinder-volume[87750]: WARNING cinder.quota [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-586439844 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-586439844, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:05:16 devstack cinder-volume[87750]: WARNING cinder.quota [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-586439844 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-586439844, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Created reservations ['15d08b71-8291-4959-85b1-3d4b694f9b65', '7a605995-e41b-403f-b4a8-02c2da016726', '97472546-3e72-41cf-958d-d5d6f44be0ab', '27e60d03-fe5c-4dbe-986d-ad86d3bed60e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a6b3dd51-a129-48e3-a492-13e1273b3a62 tempest-VolumesActionsTest-1764515551 None] Acquiring lock "cinder-17a28f80-819e-4430-a650-324ab18c0547" by "attach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a6b3dd51-a129-48e3-a492-13e1273b3a62 tempest-VolumesActionsTest-1764515551 None] Lock "cinder-17a28f80-819e-4430-a650-324ab18c0547" acquired by "attach_volume" :: waited 0.051s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:16 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Created reservations ['f6470f84-1455-4c79-b17d-a86623c1bb39', '024de5e1-03ae-4652-94e7-8598decf596e', 'e801243c-42bf-4425-9dfe-f33df21d0a63', 'b72c355d-c1c9-47a6-9cc4-0e28f6d085bb'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a6b3dd51-a129-48e3-a492-13e1273b3a62 tempest-VolumesActionsTest-1764515551 None] Attaching volume 17a28f80-819e-4430-a650-324ab18c0547 to instance 0e82e847-1651-46b3-9ed3-3af7b6f9ff9e at mountpoint /dev/vdb on host None. Jul 18 06:05:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a6b3dd51-a129-48e3-a492-13e1273b3a62 tempest-VolumesActionsTest-1764515551 None] Attach volume completed successfully. Jul 18 06:05:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a6b3dd51-a129-48e3-a492-13e1273b3a62 tempest-VolumesActionsTest-1764515551 None] Lock "cinder-17a28f80-819e-4430-a650-324ab18c0547" released by "attach_volume" :: held 0.297s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:17 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:05:17 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:17 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.538s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:17 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:05:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-512ea317-9a3f-47f1-8271-841bf504a4c0 tempest-GroupsTest-1417880269 None] Delete group completed successfully. Jul 18 06:05:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3ab4490d-5bfc-4725-a152-dca20e7e7c10 tempest-VolumesActionsTest-887960859 None] Terminate volume connection completed successfully. Jul 18 06:05:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ab4490d-5bfc-4725-a152-dca20e7e7c10 tempest-VolumesActionsTest-887960859 None] Acquiring lock "cinder-17a28f80-819e-4430-a650-324ab18c0547-detach_volume" by "detach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ab4490d-5bfc-4725-a152-dca20e7e7c10 tempest-VolumesActionsTest-887960859 None] Lock "cinder-17a28f80-819e-4430-a650-324ab18c0547-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3ab4490d-5bfc-4725-a152-dca20e7e7c10 tempest-VolumesActionsTest-887960859 None] Detaching volume 17a28f80-819e-4430-a650-324ab18c0547 from instance 0e82e847-1651-46b3-9ed3-3af7b6f9ff9e. Jul 18 06:05:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3ab4490d-5bfc-4725-a152-dca20e7e7c10 tempest-VolumesActionsTest-887960859 None] Detach volume completed successfully. Jul 18 06:05:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ab4490d-5bfc-4725-a152-dca20e7e7c10 tempest-VolumesActionsTest-887960859 None] Lock "cinder-17a28f80-819e-4430-a650-324ab18c0547-detach_volume" released by "detach_volume" :: held 0.149s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a6d4024c-576c-44ad-9e3d-bb958d6220d6 tempest-VolumesActionsTest-1764515551 None] Acquiring lock "cinder-17a28f80-819e-4430-a650-324ab18c0547-detach_volume" by "detach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a6d4024c-576c-44ad-9e3d-bb958d6220d6 tempest-VolumesActionsTest-1764515551 None] Lock "cinder-17a28f80-819e-4430-a650-324ab18c0547-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a6d4024c-576c-44ad-9e3d-bb958d6220d6 tempest-VolumesActionsTest-1764515551 None] Volume detach called, but volume not attached. Jul 18 06:05:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a6d4024c-576c-44ad-9e3d-bb958d6220d6 tempest-VolumesActionsTest-1764515551 None] Lock "cinder-17a28f80-819e-4430-a650-324ab18c0547-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Acquiring lock "cinder-17a28f80-819e-4430-a650-324ab18c0547-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Lock "cinder-17a28f80-819e-4430-a650-324ab18c0547-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Acquiring lock "cinder-quobyte-17a28f80-819e-4430-a650-324ab18c0547" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Lock "cinder-quobyte-17a28f80-819e-4430-a650-324ab18c0547" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:20 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bbab0d-dccf-4232-a5f5-374c11b05802]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-17a28f80-819e-4430-a650-324ab18c0547 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:20 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-17a28f80-819e-4430-a650-324ab18c0547 Jul 18 06:05:20 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:20 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-17a28f80-819e-4430-a650-324ab18c0547" returned: 0 in 0.685s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-17a28f80-819e-4430-a650-324ab18c0547 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:20 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-17a28f80-819e-4430-a650-324ab18c0547 Jul 18 06:05:20 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:21 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-17a28f80-819e-4430-a650-324ab18c0547" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Lock "cinder-quobyte-17a28f80-819e-4430-a650-324ab18c0547" released by "delete_volume" :: held 1.135s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:21 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Created reservations ['8c04232a-cb0f-4a7b-9fad-9f834f5b9f21', 'afda3c8e-f06c-450c-a3f2-90bb8e42a0da', '49a7b655-6fe3-4529-b58f-acdb55335a72', 'f27e02a1-4ac8-4900-8311-183e71feee5a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:21 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:05:21 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:22 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.609s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:22 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:05:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Deleted volume successfully. Jul 18 06:05:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4577241f-53fb-4e8a-897f-7b232573f55c tempest-VolumesActionsTest-1764515551 None] Lock "cinder-17a28f80-819e-4430-a650-324ab18c0547-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Flow 'volume_create_manager' (27e1ad1c-2583-4d1d-9e64-0d7d14027b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f0dad3-d33c-493f-b9fd-8947c2c3aa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f0dad3-d33c-493f-b9fd-8947c2c3aa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1476560384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e62429b-f1a4-48be-8f70-b61504e377c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e40f46975544118a4826060a8beadc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:27Z,use_quota=True,user_id='026174c00d3c4adcb6d0fe668ca17978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58af976-b17e-4930-9834-6ba9e77b3f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58af976-b17e-4930-9834-6ba9e77b3f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6500999-c279-4cae-a9e6-5c43bdc458d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6500999-c279-4cae-a9e6-5c43bdc458d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e62429b-f1a4-48be-8f70-b61504e377c4', 'volume_name': 'volume-5e62429b-f1a4-48be-8f70-b61504e377c4', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2b7592-3fd8-4bd0-930a-96d31d845cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2b7592-3fd8-4bd0-930a-96d31d845cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3d23fc-a0a1-4f89-9021-ab057507ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:27 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Volume 5e62429b-f1a4-48be-8f70-b61504e377c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e62429b-f1a4-48be-8f70-b61504e377c4', 'volume_size': 1} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1476560384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e62429b-f1a4-48be-8f70-b61504e377c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e40f46975544118a4826060a8beadc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:27Z,use_quota=True,user_id='026174c00d3c4adcb6d0fe668ca17978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Creating volume 5e62429b-f1a4-48be-8f70-b61504e377c4 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:05:27 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:05:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e62429b-f1a4-48be-8f70-b61504e377c4 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:27 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e62429b-f1a4-48be-8f70-b61504e377c4 1073741824 Jul 18 06:05:27 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:28 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e62429b-f1a4-48be-8f70-b61504e377c4 1073741824" returned: 0 in 0.756s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e62429b-f1a4-48be-8f70-b61504e377c4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:28 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e62429b-f1a4-48be-8f70-b61504e377c4 Jul 18 06:05:28 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:28 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e62429b-f1a4-48be-8f70-b61504e377c4" returned: 0 in 0.287s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:05:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3d23fc-a0a1-4f89-9021-ab057507ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e62429b-f1a4-48be-8f70-b61504e377c4', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16074570-4470-4b82-bf0c-02acc885baa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:28 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Volume volume-5e62429b-f1a4-48be-8f70-b61504e377c4 (5e62429b-f1a4-48be-8f70-b61504e377c4): created successfully Jul 18 06:05:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16074570-4470-4b82-bf0c-02acc885baa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Flow 'volume_create_manager' (27e1ad1c-2583-4d1d-9e64-0d7d14027b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1a32746c-e682-4093-8f69-bbd6362eab48 tempest-VolumesActionsTest-1764515551 None] Created volume successfully. Jul 18 06:05:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Acquiring lock "cinder-5e62429b-f1a4-48be-8f70-b61504e377c4-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Lock "cinder-5e62429b-f1a4-48be-8f70-b61504e377c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Acquiring lock "cinder-quobyte-5e62429b-f1a4-48be-8f70-b61504e377c4" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Lock "cinder-quobyte-5e62429b-f1a4-48be-8f70-b61504e377c4" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:29 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ce7330-db4e-47b9-908c-3c8935007571]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e62429b-f1a4-48be-8f70-b61504e377c4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:30 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e62429b-f1a4-48be-8f70-b61504e377c4 Jul 18 06:05:30 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:30 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e62429b-f1a4-48be-8f70-b61504e377c4" returned: 0 in 0.566s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e62429b-f1a4-48be-8f70-b61504e377c4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:30 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e62429b-f1a4-48be-8f70-b61504e377c4 Jul 18 06:05:30 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:31 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e62429b-f1a4-48be-8f70-b61504e377c4" returned: 0 in 0.555s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Lock "cinder-quobyte-5e62429b-f1a4-48be-8f70-b61504e377c4" released by "delete_volume" :: held 1.227s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:31 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Created reservations ['562325ba-d403-4d34-9fd5-8e6aa2c44ed1', '883eaa5a-a368-4a3f-83eb-93d62c3b56c3', 'b184945f-5b08-4304-8ce2-f65c4fdef83c', '09aa4d70-eb9e-4ed9-bd0c-779f7053ce98'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:31 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:05:31 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:31 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.290s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:31 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:05:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Deleted volume successfully. Jul 18 06:05:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e08da36-5d8b-4351-a797-ea16513601ce tempest-VolumesActionsTest-887960859 None] Lock "cinder-5e62429b-f1a4-48be-8f70-b61504e377c4-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Flow 'volume_create_manager' (bfb31f3e-59a3-4a06-a695-cf6816955d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76d783f-4c50-4d25-b6a2-591ad3ea2b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76d783f-4c50-4d25-b6a2-591ad3ea2b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1061204095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c497cde-8b9f-465b-8caa-63612dce69e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e40f46975544118a4826060a8beadc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:33Z,use_quota=True,user_id='026174c00d3c4adcb6d0fe668ca17978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861f8c71-46a4-4e53-afed-8556714aef8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861f8c71-46a4-4e53-afed-8556714aef8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a801f3b0-36e7-4034-ae1a-77075b14d3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a801f3b0-36e7-4034-ae1a-77075b14d3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c497cde-8b9f-465b-8caa-63612dce69e7', 'volume_name': 'volume-2c497cde-8b9f-465b-8caa-63612dce69e7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f3e1ed-cd23-4a5f-beee-ff8cac016cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f3e1ed-cd23-4a5f-beee-ff8cac016cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cbda235-8dec-4bf2-8408-e4c071168076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:33 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Volume 2c497cde-8b9f-465b-8caa-63612dce69e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c497cde-8b9f-465b-8caa-63612dce69e7', 'volume_size': 1} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1061204095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c497cde-8b9f-465b-8caa-63612dce69e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e40f46975544118a4826060a8beadc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:33Z,use_quota=True,user_id='026174c00d3c4adcb6d0fe668ca17978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Creating volume 2c497cde-8b9f-465b-8caa-63612dce69e7 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:05:33 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2c497cde-8b9f-465b-8caa-63612dce69e7 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:33 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2c497cde-8b9f-465b-8caa-63612dce69e7 1073741824 Jul 18 06:05:33 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:33 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2c497cde-8b9f-465b-8caa-63612dce69e7 1073741824" returned: 0 in 0.545s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2c497cde-8b9f-465b-8caa-63612dce69e7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:33 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2c497cde-8b9f-465b-8caa-63612dce69e7 Jul 18 06:05:33 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:34 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2c497cde-8b9f-465b-8caa-63612dce69e7" returned: 0 in 0.342s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cbda235-8dec-4bf2-8408-e4c071168076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c497cde-8b9f-465b-8caa-63612dce69e7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d992836-51fe-4f0d-9c28-5811a744339f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Volume volume-2c497cde-8b9f-465b-8caa-63612dce69e7 (2c497cde-8b9f-465b-8caa-63612dce69e7): created successfully Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d992836-51fe-4f0d-9c28-5811a744339f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Flow 'volume_create_manager' (bfb31f3e-59a3-4a06-a695-cf6816955d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-39c8b789-a50c-49a5-98de-c1d2fd708ea9 tempest-VolumesActionsTest-1764515551 None] Created volume successfully. Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Flow 'volume_create_manager' (069f902d-726b-42a0-8833-460c7ca1a4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edcb5de-5b3b-4109-90a4-dfef6cad9761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edcb5de-5b3b-4109-90a4-dfef6cad9761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-671296762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35014d16-a83f-472d-9a12-be4a37d2d7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20558ce133da4402ae25774563608565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:34Z,use_quota=True,user_id='f48559ed9b8e4467a66fa512fa937047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac6f052-28d9-4188-bc20-87a9e2640156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ac6f052-28d9-4188-bc20-87a9e2640156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c1a969-5fd1-400b-889a-a435950d4f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c1a969-5fd1-400b-889a-a435950d4f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35014d16-a83f-472d-9a12-be4a37d2d7ee', 'volume_name': 'volume-35014d16-a83f-472d-9a12-be4a37d2d7ee', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc84976-2c4b-4d02-ad54-d4d86d013940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc84976-2c4b-4d02-ad54-d4d86d013940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46500c63-4c99-4b35-8196-fdecf3041008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Volume 35014d16-a83f-472d-9a12-be4a37d2d7ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35014d16-a83f-472d-9a12-be4a37d2d7ee', 'volume_size': 1} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-671296762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35014d16-a83f-472d-9a12-be4a37d2d7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20558ce133da4402ae25774563608565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:34Z,use_quota=True,user_id='f48559ed9b8e4467a66fa512fa937047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Creating volume 35014d16-a83f-472d-9a12-be4a37d2d7ee {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:05:34 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-35014d16-a83f-472d-9a12-be4a37d2d7ee 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:34 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-35014d16-a83f-472d-9a12-be4a37d2d7ee 1073741824 Jul 18 06:05:34 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:34 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-35014d16-a83f-472d-9a12-be4a37d2d7ee 1073741824" returned: 0 in 0.509s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-35014d16-a83f-472d-9a12-be4a37d2d7ee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:35 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-35014d16-a83f-472d-9a12-be4a37d2d7ee Jul 18 06:05:35 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:35 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:05:35 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:35 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-35014d16-a83f-472d-9a12-be4a37d2d7ee" returned: 0 in 0.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46500c63-4c99-4b35-8196-fdecf3041008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35014d16-a83f-472d-9a12-be4a37d2d7ee', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feda25d9-d4a8-411c-b740-6791a3a7e2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:35 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Volume volume-35014d16-a83f-472d-9a12-be4a37d2d7ee (35014d16-a83f-472d-9a12-be4a37d2d7ee): created successfully Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feda25d9-d4a8-411c-b740-6791a3a7e2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Flow 'volume_create_manager' (069f902d-726b-42a0-8833-460c7ca1a4c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Acquiring lock "cinder-2c497cde-8b9f-465b-8caa-63612dce69e7-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-011fd3e2-5080-47a0-8b35-f08e175835c2 tempest-TestMinimumBasicScenario-1400255656 None] Created volume successfully. Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Lock "cinder-2c497cde-8b9f-465b-8caa-63612dce69e7-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Acquiring lock "cinder-quobyte-2c497cde-8b9f-465b-8caa-63612dce69e7" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:35 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.502s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Lock "cinder-quobyte-2c497cde-8b9f-465b-8caa-63612dce69e7" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[757d1b4b-da24-412a-8b44-8ab31260405f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2c497cde-8b9f-465b-8caa-63612dce69e7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:35 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2c497cde-8b9f-465b-8caa-63612dce69e7 Jul 18 06:05:35 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:36 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2c497cde-8b9f-465b-8caa-63612dce69e7" returned: 0 in 0.516s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2c497cde-8b9f-465b-8caa-63612dce69e7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:36 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2c497cde-8b9f-465b-8caa-63612dce69e7 Jul 18 06:05:36 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:36 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2c497cde-8b9f-465b-8caa-63612dce69e7" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Lock "cinder-quobyte-2c497cde-8b9f-465b-8caa-63612dce69e7" released by "delete_volume" :: held 0.895s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:36 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Created reservations ['4c84ffa4-3a26-4f58-be63-6382e93c8452', 'edf68ffa-5cdb-4026-a075-f96967abc7d8', '3ab0b1c7-2d2c-45ec-a679-0724fc9224e6', '92045b36-a507-4e17-a908-1236043b7066'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:36 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:05:37 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Flow 'volume_create_manager' (98ede9b7-3242-41c7-b2cd-5b8f3008bb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49ce0d8-84c6-4b94-a80d-cb3bd49ac3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:37 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.497s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49ce0d8-84c6-4b94-a80d-cb3bd49ac3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-741899729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6da458d-37c1-4cbf-9789-63d2ebff3457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b30318e1ce49239f58b0bb0b39b0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:37Z,use_quota=True,user_id='cc7633c72bad4eee86be034836e42d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99bbfb3-6a35-4c8b-894c-de5f901ff930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99bbfb3-6a35-4c8b-894c-de5f901ff930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074c143d-952d-4e6b-b4a0-09e44e0e4331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074c143d-952d-4e6b-b4a0-09e44e0e4331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6da458d-37c1-4cbf-9789-63d2ebff3457', 'volume_name': 'volume-d6da458d-37c1-4cbf-9789-63d2ebff3457', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5f4f40-3ccf-45f2-bdb3-33972728e997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5f4f40-3ccf-45f2-bdb3-33972728e997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b475c2-f811-4662-bd3f-9544288225ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:37 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Volume d6da458d-37c1-4cbf-9789-63d2ebff3457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6da458d-37c1-4cbf-9789-63d2ebff3457', 'volume_size': 1} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-741899729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6da458d-37c1-4cbf-9789-63d2ebff3457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b30318e1ce49239f58b0bb0b39b0ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:37Z,use_quota=True,user_id='cc7633c72bad4eee86be034836e42d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Creating volume d6da458d-37c1-4cbf-9789-63d2ebff3457 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:05:37 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Deleted volume successfully. Jul 18 06:05:37 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 1073741824 Jul 18 06:05:37 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1cce3cc3-8e18-4841-8a6b-c9e141322c80 tempest-VolumesActionsTest-887960859 None] Lock "cinder-2c497cde-8b9f-465b-8caa-63612dce69e7-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-d346542a-7a11-4a2c-b938-7886975ed2e4 req-6e5920ef-f151-42df-9cd1-2e7e10e372f0 tempest-TestMinimumBasicScenario-1400255656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:38 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 1073741824" returned: 0 in 0.700s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:38 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 Jul 18 06:05:38 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:38 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457" returned: 0 in 0.300s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-d346542a-7a11-4a2c-b938-7886975ed2e4 req-6e5920ef-f151-42df-9cd1-2e7e10e372f0 tempest-TestMinimumBasicScenario-1400255656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.479s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b475c2-f811-4662-bd3f-9544288225ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6da458d-37c1-4cbf-9789-63d2ebff3457', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d3dab6-a953-45b6-bd59-e9527e381a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-d346542a-7a11-4a2c-b938-7886975ed2e4 req-6e5920ef-f151-42df-9cd1-2e7e10e372f0 tempest-TestMinimumBasicScenario-1400255656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:38 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Volume volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 (d6da458d-37c1-4cbf-9789-63d2ebff3457): created successfully Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d3dab6-a953-45b6-bd59-e9527e381a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Flow 'volume_create_manager' (98ede9b7-3242-41c7-b2cd-5b8f3008bb77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-37511bbc-41e3-46f9-95d2-1e8c29a91eb2 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Created volume successfully. Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-d346542a-7a11-4a2c-b938-7886975ed2e4 req-6e5920ef-f151-42df-9cd1-2e7e10e372f0 tempest-TestMinimumBasicScenario-1400255656 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-35014d16-a83f-472d-9a12-be4a37d2d7ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f1f8024-665d-4b31-9a3c-0d40c6b586cd', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Flow 'volume_create_manager' (baee765f-7fee-4ee4-92e8-547848168386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b3cdf9-513a-43be-b0ff-8598b7e6c7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73b3cdf9-513a-43be-b0ff-8598b7e6c7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-184222354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09011c98-7f7e-43bc-816c-ea72334b6afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e40f46975544118a4826060a8beadc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:39Z,use_quota=True,user_id='026174c00d3c4adcb6d0fe668ca17978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dce8d62-bdfd-4ded-bc54-0d031ecb38bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dce8d62-bdfd-4ded-bc54-0d031ecb38bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b93c5c-f44d-4385-99fb-b9001b5a53ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21b93c5c-f44d-4385-99fb-b9001b5a53ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09011c98-7f7e-43bc-816c-ea72334b6afc', 'volume_name': 'volume-09011c98-7f7e-43bc-816c-ea72334b6afc', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cd11a8-f7f3-4171-8c7c-9705501ea9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cd11a8-f7f3-4171-8c7c-9705501ea9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163a8e01-22bd-4dfb-8727-5ba4d4e0311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:38 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Volume 09011c98-7f7e-43bc-816c-ea72334b6afc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09011c98-7f7e-43bc-816c-ea72334b6afc', 'volume_size': 1} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-184222354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09011c98-7f7e-43bc-816c-ea72334b6afc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e40f46975544118a4826060a8beadc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:39Z,use_quota=True,user_id='026174c00d3c4adcb6d0fe668ca17978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Creating volume 09011c98-7f7e-43bc-816c-ea72334b6afc {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:05:38 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:05:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-09011c98-7f7e-43bc-816c-ea72334b6afc 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-d346542a-7a11-4a2c-b938-7886975ed2e4 req-6e5920ef-f151-42df-9cd1-2e7e10e372f0 tempest-TestMinimumBasicScenario-1400255656 None] attachment_update completed successfully. Jul 18 06:05:38 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-09011c98-7f7e-43bc-816c-ea72334b6afc 1073741824 Jul 18 06:05:38 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Flow 'volume_create_manager' (a78a0ef6-1393-4cd9-ae44-42354bb36c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8758507d-2953-451d-bc7f-626efea8623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8758507d-2953-451d-bc7f-626efea8623c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1984018466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001c234d-92e7-4150-af74-6f1445035657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd6c7a4f1dd4619b18aee06fb68a7d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:39Z,use_quota=True,user_id='f955832c646e4e50aa7cdfb4e8bf2b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1c65f6-cd9b-40e3-92a3-1ede06797e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be1c65f6-cd9b-40e3-92a3-1ede06797e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb63a607-3280-4362-a592-9fcd32ce48ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb63a607-3280-4362-a592-9fcd32ce48ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001c234d-92e7-4150-af74-6f1445035657', 'volume_name': 'volume-001c234d-92e7-4150-af74-6f1445035657', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df4eb68-af97-41d7-9156-c6beaf421c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df4eb68-af97-41d7-9156-c6beaf421c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a587bf21-fbf9-474a-b9de-7e335ffad010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Volume 001c234d-92e7-4150-af74-6f1445035657: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001c234d-92e7-4150-af74-6f1445035657', 'volume_size': 1} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:39 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-09011c98-7f7e-43bc-816c-ea72334b6afc 1073741824" returned: 0 in 0.749s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-09011c98-7f7e-43bc-816c-ea72334b6afc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:39 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-09011c98-7f7e-43bc-816c-ea72334b6afc Jul 18 06:05:39 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:39 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-09011c98-7f7e-43bc-816c-ea72334b6afc" returned: 0 in 0.286s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1984018466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001c234d-92e7-4150-af74-6f1445035657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd6c7a4f1dd4619b18aee06fb68a7d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:39Z,use_quota=True,user_id='f955832c646e4e50aa7cdfb4e8bf2b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Creating volume 001c234d-92e7-4150-af74-6f1445035657 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:05:39 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:05:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-001c234d-92e7-4150-af74-6f1445035657 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:40 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-001c234d-92e7-4150-af74-6f1445035657 1073741824 Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163a8e01-22bd-4dfb-8727-5ba4d4e0311e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09011c98-7f7e-43bc-816c-ea72334b6afc', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:40 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abd7c0e-3718-4ea7-9da4-7b842d94e4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Volume volume-09011c98-7f7e-43bc-816c-ea72334b6afc (09011c98-7f7e-43bc-816c-ea72334b6afc): created successfully Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abd7c0e-3718-4ea7-9da4-7b842d94e4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Flow 'volume_create_manager' (baee765f-7fee-4ee4-92e8-547848168386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-678edbbe-195c-4827-a828-b1f308dfc450 tempest-VolumesActionsTest-1764515551 None] Created volume successfully. Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Acquiring lock "cinder-09011c98-7f7e-43bc-816c-ea72334b6afc-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Lock "cinder-09011c98-7f7e-43bc-816c-ea72334b6afc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Acquiring lock "cinder-quobyte-09011c98-7f7e-43bc-816c-ea72334b6afc" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Lock "cinder-quobyte-09011c98-7f7e-43bc-816c-ea72334b6afc" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdd8c74-8aa1-4472-89c7-7391c32310ae]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-09011c98-7f7e-43bc-816c-ea72334b6afc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:40 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-001c234d-92e7-4150-af74-6f1445035657 1073741824" returned: 0 in 0.657s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-001c234d-92e7-4150-af74-6f1445035657 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:40 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-001c234d-92e7-4150-af74-6f1445035657 Jul 18 06:05:40 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:40 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-09011c98-7f7e-43bc-816c-ea72334b6afc Jul 18 06:05:40 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:40 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-001c234d-92e7-4150-af74-6f1445035657" returned: 0 in 0.306s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.411s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Creating offline snapshot 92268b4d-dd4b-4a81-9b33-9fe1d5d7064a of volume d6da458d-37c1-4cbf-9789-63d2ebff3457 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a587bf21-fbf9-474a-b9de-7e335ffad010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001c234d-92e7-4150-af74-6f1445035657', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:41 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eef8ca1-2a0a-4833-8659-e90389516db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dc7f65-87b1-4054-8514-709f5de66efe]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-09011c98-7f7e-43bc-816c-ea72334b6afc" returned: 0 in 0.476s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-09011c98-7f7e-43bc-816c-ea72334b6afc {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Volume volume-001c234d-92e7-4150-af74-6f1445035657 (001c234d-92e7-4150-af74-6f1445035657): created successfully Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eef8ca1-2a0a-4833-8659-e90389516db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:41 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-09011c98-7f7e-43bc-816c-ea72334b6afc Jul 18 06:05:41 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Flow 'volume_create_manager' (a78a0ef6-1393-4cd9-ae44-42354bb36c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d9cbbd7a-cb43-4f06-89e3-41a8936c4522 tempest-AttachVolumeNegativeTest-277769288 None] Created volume successfully. Jul 18 06:05:41 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 Jul 18 06:05:41 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:41 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-09011c98-7f7e-43bc-816c-ea72334b6afc" returned: 0 in 0.424s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Lock "cinder-quobyte-09011c98-7f7e-43bc-816c-ea72334b6afc" released by "delete_volume" :: held 0.959s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Created reservations ['8fe85bd0-2392-4180-835d-f5f73e12feaa', 'e971115e-88f8-4533-b7e0-2d03f8576cab', '792ca091-0307-4d6d-ae5b-24e11bfde9f5', '4aaec08e-1a5c-4b2a-9696-0232043e9c8c'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:41 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457" returned: 0 in 0.585s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:41 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a 1G Jul 18 06:05:41 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:41 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:05:41 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:42 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.462s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:42 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:05:42 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Deleted volume successfully. Jul 18 06:05:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cf56c67e-853a-4c98-b336-b281bf6bbc5e tempest-VolumesActionsTest-887960859 None] Lock "cinder-09011c98-7f7e-43bc-816c-ea72334b6afc-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:42 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a 1G" returned: 0 in 0.750s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:42 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a Jul 18 06:05:42 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-cd04f78c-b3b8-4702-b610-956c4ff25c64 req-73ecc5fa-65cf-4876-b97c-f1b9a02646c4 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:43 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a" returned: 0 in 0.658s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:43 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a is being set with open permissions: ugo+rw Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:43 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a Jul 18 06:05:43 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:43 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a" returned: 0 in 0.281s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:43 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.info Jul 18 06:05:43 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Flow 'volume_create_manager' (73b667f3-e313-455c-acf8-b62d94ae57de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:43 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dac4b62-c5b9-493b-ac2c-bbbf326f3164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.info" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:43 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.info is being set with open permissions: ugo+rw Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dac4b62-c5b9-493b-ac2c-bbbf326f3164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1272240440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d8a9bd-8b6b-4533-8898-4f449f094056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e40f46975544118a4826060a8beadc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:44Z,use_quota=True,user_id='026174c00d3c4adcb6d0fe668ca17978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:43 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.info Jul 18 06:05:43 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b1cb18-473b-4c3e-a329-872a390db670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b1cb18-473b-4c3e-a329-872a390db670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8c5173-2540-4cdd-a36b-59e753616a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8c5173-2540-4cdd-a36b-59e753616a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d8a9bd-8b6b-4533-8898-4f449f094056', 'volume_name': 'volume-03d8a9bd-8b6b-4533-8898-4f449f094056', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7805c230-16b2-44dc-923c-4437c6dcbe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7805c230-16b2-44dc-923c-4437c6dcbe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fdbec42-4132-4979-a46e-ea87b6d51278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Volume 03d8a9bd-8b6b-4533-8898-4f449f094056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d8a9bd-8b6b-4533-8898-4f449f094056', 'volume_size': 1} Jul 18 06:05:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:44 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.info" returned: 0 in 0.333s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.108s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-cd04f78c-b3b8-4702-b610-956c4ff25c64 req-73ecc5fa-65cf-4876-b97c-f1b9a02646c4 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.188s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-cd04f78c-b3b8-4702-b610-956c4ff25c64 req-73ecc5fa-65cf-4876-b97c-f1b9a02646c4 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.274s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1272240440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d8a9bd-8b6b-4533-8898-4f449f094056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e40f46975544118a4826060a8beadc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:44Z,use_quota=True,user_id='026174c00d3c4adcb6d0fe668ca17978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Creating volume 03d8a9bd-8b6b-4533-8898-4f449f094056 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:05:44 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-03d8a9bd-8b6b-4533-8898-4f449f094056 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:44 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-03d8a9bd-8b6b-4533-8898-4f449f094056 1073741824 Jul 18 06:05:44 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b5a3037f-debd-4ffb-92e6-09f1ddecdc92 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Create snapshot completed successfully Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-cd04f78c-b3b8-4702-b610-956c4ff25c64 req-73ecc5fa-65cf-4876-b97c-f1b9a02646c4 tempest-AttachVolumeNegativeTest-277769288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-001c234d-92e7-4150-af74-6f1445035657', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69696f47-a8ea-4324-b85c-b13d88d03f5c', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:05:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-cd04f78c-b3b8-4702-b610-956c4ff25c64 req-73ecc5fa-65cf-4876-b97c-f1b9a02646c4 tempest-AttachVolumeNegativeTest-277769288 None] attachment_update completed successfully. Jul 18 06:05:44 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-03d8a9bd-8b6b-4533-8898-4f449f094056 1073741824" returned: 0 in 0.760s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-03d8a9bd-8b6b-4533-8898-4f449f094056 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:44 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-03d8a9bd-8b6b-4533-8898-4f449f094056 Jul 18 06:05:44 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:45 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-03d8a9bd-8b6b-4533-8898-4f449f094056" returned: 0 in 0.396s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fdbec42-4132-4979-a46e-ea87b6d51278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d8a9bd-8b6b-4533-8898-4f449f094056', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ba7d64-4ddd-4320-bc15-265d0b36e4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:45 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Volume volume-03d8a9bd-8b6b-4533-8898-4f449f094056 (03d8a9bd-8b6b-4533-8898-4f449f094056): created successfully Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ba7d64-4ddd-4320-bc15-265d0b36e4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Flow 'volume_create_manager' (73b667f3-e313-455c-acf8-b62d94ae57de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cbc8420d-91fe-421a-ab4a-d039fb01d38a tempest-VolumesActionsTest-1764515551 None] Created volume successfully. Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Acquiring lock "cinder-92268b4d-dd4b-4a81-9b33-9fe1d5d7064a-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "cinder-92268b4d-dd4b-4a81-9b33-9fe1d5d7064a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Acquiring lock "cinder-quobyte-d6da458d-37c1-4cbf-9789-63d2ebff3457" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "cinder-quobyte-d6da458d-37c1-4cbf-9789-63d2ebff3457" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Acquiring lock "cinder-quobyte-92268b4d-dd4b-4a81-9b33-9fe1d5d7064a" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "cinder-quobyte-92268b4d-dd4b-4a81-9b33-9fe1d5d7064a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Deleting offline snapshot 92268b4d-dd4b-4a81-9b33-9fe1d5d7064a of volume d6da458d-37c1-4cbf-9789-63d2ebff3457 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] snapshot_file for this snap is: volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b6b47a-a099-4d4e-be95-9d4bfbd14d5c]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:45 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a Jul 18 06:05:45 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Acquiring lock "cinder-03d8a9bd-8b6b-4533-8898-4f449f094056-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Lock "cinder-03d8a9bd-8b6b-4533-8898-4f449f094056-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Acquiring lock "cinder-quobyte-03d8a9bd-8b6b-4533-8898-4f449f094056" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Lock "cinder-quobyte-03d8a9bd-8b6b-4533-8898-4f449f094056" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6441ba31-ab40-4161-a638-8ff104bf88fa]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-03d8a9bd-8b6b-4533-8898-4f449f094056 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:46 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a" returned: 0 in 0.536s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6da458d-37c1-4cbf-9789-63d2ebff3457(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:05:46 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-03d8a9bd-8b6b-4533-8898-4f449f094056 Jul 18 06:05:46 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6532d6c-3649-48a3-a4a5-7bb6a40fbeca]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:46 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 Jul 18 06:05:46 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:46 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-03d8a9bd-8b6b-4533-8898-4f449f094056" returned: 0 in 0.520s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-03d8a9bd-8b6b-4533-8898-4f449f094056 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:46 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-03d8a9bd-8b6b-4533-8898-4f449f094056 Jul 18 06:05:46 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:46 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457" returned: 0 in 0.530s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:46 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a Jul 18 06:05:46 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-1c129cca-939d-4a58-b375-9cbb80cacaa9 req-9b6b0161-7c6a-4d83-8d76-d08464ecf945 tempest-AttachVolumeNegativeTest-277769288 None] Terminate volume connection completed successfully. Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-1c129cca-939d-4a58-b375-9cbb80cacaa9 req-9b6b0161-7c6a-4d83-8d76-d08464ecf945 tempest-AttachVolumeNegativeTest-277769288 None] Deleting attachment 69696f47-a8ea-4324-b85c-b13d88d03f5c. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:05:46 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-03d8a9bd-8b6b-4533-8898-4f449f094056" returned: 0 in 0.340s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Lock "cinder-quobyte-03d8a9bd-8b6b-4533-8898-4f449f094056" released by "delete_volume" :: held 0.937s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Created reservations ['913890c2-be32-41f0-9519-45300108dc4f', 'eb17ecb5-510f-4b1a-be08-5b178c69458d', '691cec71-f97c-431a-b506-278ed2e8a683', '3074b79f-7fb6-4e43-b367-0d6abfd1daae'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:47 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:05:47 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:47 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a" returned: 0 in 0.486s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:47 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a Jul 18 06:05:47 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:47 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.269s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:05:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Deleted volume successfully. Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b25979b5-d7a0-4507-99d1-491186030f2b tempest-VolumesActionsTest-887960859 None] Lock "cinder-03d8a9bd-8b6b-4533-8898-4f449f094056-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:47 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457.92268b4d-dd4b-4a81-9b33-9fe1d5d7064a" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "cinder-quobyte-92268b4d-dd4b-4a81-9b33-9fe1d5d7064a" released by "_delete_snapshot" :: held 1.976s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "cinder-quobyte-d6da458d-37c1-4cbf-9789-63d2ebff3457" released by "delete_snapshot" :: held 2.021s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Created reservations ['0504595e-fc4e-4a8b-ad37-5ced1da25514', '2361e8a1-73e7-4ff0-958e-c21bb5bc1189', '19e49af3-3a86-410b-b50d-ebbd2626b68a', '8a1ff755-b19b-42a0-b338-4278e1a27afd'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Delete snapshot completed successfully. Jul 18 06:05:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-968c9fcb-bd93-472b-b59f-d4397369afd7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "cinder-92268b4d-dd4b-4a81-9b33-9fe1d5d7064a-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Acquiring lock "cinder-d6da458d-37c1-4cbf-9789-63d2ebff3457-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "cinder-d6da458d-37c1-4cbf-9789-63d2ebff3457-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Acquiring lock "cinder-quobyte-d6da458d-37c1-4cbf-9789-63d2ebff3457" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "cinder-quobyte-d6da458d-37c1-4cbf-9789-63d2ebff3457" acquired by "delete_volume" :: waited 0.046s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[09275b62-9a5a-4cd6-8f26-58204629609f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Flow 'volume_create_manager' (b7a15481-ee49-4742-83d8-2d100f4ba77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801904b1-8768-46af-a72f-f0921790cb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801904b1-8768-46af-a72f-f0921790cb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-918499243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03bf2b6-0508-46c4-8df8-977780a314cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e40f46975544118a4826060a8beadc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:49Z,use_quota=True,user_id='026174c00d3c4adcb6d0fe668ca17978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ea593c-e392-4b2e-8d3b-61ba095244a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ea593c-e392-4b2e-8d3b-61ba095244a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b836845d-4408-44a6-bb0a-8665362087cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b836845d-4408-44a6-bb0a-8665362087cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03bf2b6-0508-46c4-8df8-977780a314cb', 'volume_name': 'volume-d03bf2b6-0508-46c4-8df8-977780a314cb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7991cb-45fa-4b14-9e42-80912b73c263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7991cb-45fa-4b14-9e42-80912b73c263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc083209-ba8e-43f0-a71e-6e8e0188a95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Volume d03bf2b6-0508-46c4-8df8-977780a314cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03bf2b6-0508-46c4-8df8-977780a314cb', 'volume_size': 1} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-918499243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03bf2b6-0508-46c4-8df8-977780a314cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e40f46975544118a4826060a8beadc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:49Z,use_quota=True,user_id='026174c00d3c4adcb6d0fe668ca17978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Creating volume d03bf2b6-0508-46c4-8df8-977780a314cb {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:05:49 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d03bf2b6-0508-46c4-8df8-977780a314cb 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:49 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 Jul 18 06:05:49 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:49 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d03bf2b6-0508-46c4-8df8-977780a314cb 1073741824 Jul 18 06:05:49 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:49 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457" returned: 0 in 0.602s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:49 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457 Jul 18 06:05:49 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:50 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d6da458d-37c1-4cbf-9789-63d2ebff3457" returned: 0 in 0.427s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "cinder-quobyte-d6da458d-37c1-4cbf-9789-63d2ebff3457" released by "delete_volume" :: held 1.126s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:50 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d03bf2b6-0508-46c4-8df8-977780a314cb 1073741824" returned: 0 in 0.843s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d03bf2b6-0508-46c4-8df8-977780a314cb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Created reservations ['d87a73fe-b50e-4365-a8c0-52f269ba8641', '7ec031fe-2be7-485b-be5b-7c542131fe54', '3f3a3f06-2159-401a-9e85-a5b20bb1e1e9', '01dc66b5-6654-4b30-8060-0657d69649a0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:50 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d03bf2b6-0508-46c4-8df8-977780a314cb Jul 18 06:05:50 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:50 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:05:50 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:50 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d03bf2b6-0508-46c4-8df8-977780a314cb" returned: 0 in 0.360s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc083209-ba8e-43f0-a71e-6e8e0188a95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03bf2b6-0508-46c4-8df8-977780a314cb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8629d1af-f1a1-48dc-8107-d6882c1d35e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Volume volume-d03bf2b6-0508-46c4-8df8-977780a314cb (d03bf2b6-0508-46c4-8df8-977780a314cb): created successfully Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8629d1af-f1a1-48dc-8107-d6882c1d35e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Flow 'volume_create_manager' (b7a15481-ee49-4742-83d8-2d100f4ba77b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-84ddd1f8-42d4-4417-8555-3d39102fa84c tempest-VolumesActionsTest-1764515551 None] Created volume successfully. Jul 18 06:05:50 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:05:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Deleted volume successfully. Jul 18 06:05:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b87aa3c6-d9d6-4a52-8f58-f0b61b149dec tempest-VolumeSnapshotQuotasNegativeTestJSON-2090488558 None] Lock "cinder-d6da458d-37c1-4cbf-9789-63d2ebff3457-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Acquiring lock "cinder-d03bf2b6-0508-46c4-8df8-977780a314cb-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Lock "cinder-d03bf2b6-0508-46c4-8df8-977780a314cb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Acquiring lock "cinder-quobyte-d03bf2b6-0508-46c4-8df8-977780a314cb" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Lock "cinder-quobyte-d03bf2b6-0508-46c4-8df8-977780a314cb" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03d5e92-c472-4002-90a7-20a9f85162cf]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d03bf2b6-0508-46c4-8df8-977780a314cb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:52 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d03bf2b6-0508-46c4-8df8-977780a314cb Jul 18 06:05:52 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:52 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d03bf2b6-0508-46c4-8df8-977780a314cb" returned: 0 in 0.468s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d03bf2b6-0508-46c4-8df8-977780a314cb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:52 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d03bf2b6-0508-46c4-8df8-977780a314cb Jul 18 06:05:52 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:52 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d03bf2b6-0508-46c4-8df8-977780a314cb" returned: 0 in 0.391s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Lock "cinder-quobyte-d03bf2b6-0508-46c4-8df8-977780a314cb" released by "delete_volume" :: held 0.900s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Created reservations ['99ef8b43-9387-4da3-a66a-0257d8bd59bb', '25bca232-2353-4366-8e0f-90c58137dfec', '523ae490-72b8-40cf-878a-b1484116d7a5', 'dc57f0e7-b953-4a02-83ea-066356e4e105'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:53 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:05:53 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:53 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:05:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Deleted volume successfully. Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bb91b0c3-e499-472d-96f7-5ce75d7a0b09 tempest-VolumesActionsTest-1764515551 None] Lock "cinder-d03bf2b6-0508-46c4-8df8-977780a314cb-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "cinder-001c234d-92e7-4150-af74-6f1445035657-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Lock "cinder-001c234d-92e7-4150-af74-6f1445035657-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "cinder-quobyte-001c234d-92e7-4150-af74-6f1445035657" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Lock "cinder-quobyte-001c234d-92e7-4150-af74-6f1445035657" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f702f0-9e97-4772-a842-075d7d8a38e7]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-001c234d-92e7-4150-af74-6f1445035657 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:54 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-001c234d-92e7-4150-af74-6f1445035657 Jul 18 06:05:54 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:54 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-001c234d-92e7-4150-af74-6f1445035657" returned: 0 in 0.444s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-001c234d-92e7-4150-af74-6f1445035657 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:54 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-001c234d-92e7-4150-af74-6f1445035657 Jul 18 06:05:54 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:54 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-001c234d-92e7-4150-af74-6f1445035657" returned: 0 in 0.278s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Lock "cinder-quobyte-001c234d-92e7-4150-af74-6f1445035657" released by "delete_volume" :: held 0.780s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:54 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Created reservations ['1b7c855c-4802-47a5-b443-4df49f92abbf', '593a04c8-74e4-4a8a-95e6-d7c7df7aa0da', 'e70794ca-2e40-4d62-8797-fa6794f47405', '6555e0b5-7d92-4165-88d6-fc4466a5a913'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:54 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:05:54 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:55 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.358s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:05:55 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Deleted volume successfully. Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "cinder-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a118d9d8-c3be-4b70-8ef0-4850ed644adc tempest-AttachVolumeNegativeTest-277769288 None] Lock "cinder-001c234d-92e7-4150-af74-6f1445035657-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Lock "cinder-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "cinder-quobyte-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Lock "cinder-quobyte-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4150c1-a774-4a45-9a1f-604373ccd999]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:55 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364 Jul 18 06:05:55 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:55 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364" returned: 0 in 0.420s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:55 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364 Jul 18 06:05:55 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:55 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364" returned: 0 in 0.280s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Lock "cinder-quobyte-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364" released by "delete_volume" :: held 0.763s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Created reservations ['5a1fa2fb-7de7-46ee-bc38-a907c95b35ae', '10a24147-098a-4402-9c61-9f4243a3f06c', 'b8fd43bf-e6bd-482d-9677-29ae696483b3', '90add820-c577-49b3-9538-74c4f689406a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:56 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:05:56 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:56 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.376s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:05:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Deleted volume successfully. Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e8f4ffd-922c-43ee-8200-4fe809ee39f9 tempest-AttachVolumeNegativeTest-277769288 None] Lock "cinder-61f6ddcb-bc41-49d7-bdeb-42d2bf1dd364-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "cinder-5179df10-95c2-4e4a-879e-7d244e43d7f9-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Lock "cinder-5179df10-95c2-4e4a-879e-7d244e43d7f9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "cinder-quobyte-5179df10-95c2-4e4a-879e-7d244e43d7f9" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Lock "cinder-quobyte-5179df10-95c2-4e4a-879e-7d244e43d7f9" acquired by "delete_volume" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fc3473-78b3-40bf-be74-82849ce3cae7]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:05:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5179df10-95c2-4e4a-879e-7d244e43d7f9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:56 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5179df10-95c2-4e4a-879e-7d244e43d7f9 Jul 18 06:05:56 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Flow 'volume_create_manager' (2e151ea8-64ef-4472-b20d-1ec0f84e5320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d441d0-e601-47af-8469-f88826e05a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:57 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5179df10-95c2-4e4a-879e-7d244e43d7f9" returned: 0 in 0.463s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5179df10-95c2-4e4a-879e-7d244e43d7f9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d441d0-e601-47af-8469-f88826e05a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-234004267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd73cc1-e331-4b0b-ae97-e0f7fdae7128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f8baca1bf24814a2eaa3efc182a99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:57Z,use_quota=True,user_id='12f9615e56504fbc9bd80e6942b65b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:57 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5179df10-95c2-4e4a-879e-7d244e43d7f9 Jul 18 06:05:57 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e1c778-55f3-4484-9557-e2fe0555c31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e1c778-55f3-4484-9557-e2fe0555c31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6596bbac-4200-4c50-81c7-cb32bbef7a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6596bbac-4200-4c50-81c7-cb32bbef7a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd73cc1-e331-4b0b-ae97-e0f7fdae7128', 'volume_name': 'volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e96689f-43f6-40ec-bb4e-bd3cf75f06e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e96689f-43f6-40ec-bb4e-bd3cf75f06e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a618b6-6a16-4fd2-b1c0-301c1fc2a41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Volume 7bd73cc1-e331-4b0b-ae97-e0f7fdae7128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128', 'volume_size': 1} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-234004267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd73cc1-e331-4b0b-ae97-e0f7fdae7128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f8baca1bf24814a2eaa3efc182a99b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:05:57Z,use_quota=True,user_id='12f9615e56504fbc9bd80e6942b65b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Creating volume 7bd73cc1-e331-4b0b-ae97-e0f7fdae7128 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:05:57 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:57 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128 1073741824 Jul 18 06:05:57 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:57 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5179df10-95c2-4e4a-879e-7d244e43d7f9" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Lock "cinder-quobyte-5179df10-95c2-4e4a-879e-7d244e43d7f9" released by "delete_volume" :: held 0.819s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Created reservations ['f2fc1209-62dc-4f51-a920-001390fe68aa', 'c45c947e-af71-4ac5-8ba5-a8d1c6b925a9', '86b29314-3629-4ad5-978b-d9e189d62e81', 'd898b548-6dce-47a5-af98-630d978f50bc'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:57 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:05:57 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:58 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128 1073741824" returned: 0 in 0.800s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:05:58 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128 Jul 18 06:05:58 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:05:58 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.528s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:58 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:05:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Deleted volume successfully. Jul 18 06:05:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f80c5243-c797-4a59-89a6-ec70e9aea022 tempest-AttachVolumeNegativeTest-277769288 None] Lock "cinder-5179df10-95c2-4e4a-879e-7d244e43d7f9-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:05:58 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 18 06:05:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128" returned: 0 in 0.345s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:05:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:05:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:05:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a618b6-6a16-4fd2-b1c0-301c1fc2a41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d648380b-e3ff-4fa3-8869-7911d26cbe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:05:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Volume volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128 (7bd73cc1-e331-4b0b-ae97-e0f7fdae7128): created successfully Jul 18 06:05:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d648380b-e3ff-4fa3-8869-7911d26cbe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:05:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Flow 'volume_create_manager' (2e151ea8-64ef-4472-b20d-1ec0f84e5320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:05:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d23d04d7-edb9-4e45-bf07-bcdad1ad9841 tempest-VolumesMetadataTest-1674122446 None] Created volume successfully. Jul 18 06:06:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Acquiring lock "cinder-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Lock "cinder-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:00 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=124,cinder:UPDATE=151,cinder:INSERT=35,cinder:DELETE=9 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:06:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Acquiring lock "cinder-quobyte-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Lock "cinder-quobyte-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[93248fad-11fe-4c86-bcf5-768a2c53bf5a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:00 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128 Jul 18 06:06:00 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:01 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128" returned: 0 in 0.515s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:01 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128 Jul 18 06:06:01 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:01 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Lock "cinder-quobyte-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128" released by "delete_volume" :: held 0.877s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Created reservations ['fd8462df-0466-4f49-a4b2-50badd6792f8', '5501b5cd-c7a8-4680-8eb4-f5a3a7d6ca57', '45e6b2c0-9db3-4990-8bc1-df53ff202670', 'def9b5f3-6185-4331-bfc2-558df3234803'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:01 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:06:01 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:02 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.398s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:02 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:06:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Deleted volume successfully. Jul 18 06:06:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9aa56f42-0cbe-466c-90c8-a81c7eac7928 tempest-VolumesMetadataTest-1674122446 None] Lock "cinder-7bd73cc1-e331-4b0b-ae97-e0f7fdae7128-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f5921186-20b1-4612-a500-c916bc69a536 tempest-BackendsCapabilitiesAdminTestsJSON-402457523 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7434043884277, 'free_capacity_gb': 1775.7434043884277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87750) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 18 06:06:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bb6ba49e-1e79-4d34-88f6-139c2233dc5a tempest-BackendsCapabilitiesAdminTestsJSON-402457523 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7434043884277, 'free_capacity_gb': 1775.7434043884277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87750) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 18 06:06:09 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=156,cinder:SELECT=125,cinder:DELETE=14,cinder:INSERT=34 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:06:09 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:06:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Flow 'volume_create_manager' (7f25bd63-dde3-4422-b2cd-ed9db22147d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd49160a-3ded-4ec6-bf0a-1304a1b6e616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd49160a-3ded-4ec6-bf0a-1304a1b6e616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1547102662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab3d071-1ae8-4cdc-971d-d7f8c5751022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7856b0ba6b4dce887ebd58cd620390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:10Z,use_quota=True,user_id='bd122948bc7b4fe8b6e399f3b03c6051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcf01f2-8b4a-42c3-873a-2c5f94474ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcf01f2-8b4a-42c3-873a-2c5f94474ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24257b5-01a6-44a8-bd74-d337bce708fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24257b5-01a6-44a8-bd74-d337bce708fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab3d071-1ae8-4cdc-971d-d7f8c5751022', 'volume_name': 'volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec967901-d0b2-46aa-a4ba-5c7520b6dc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec967901-d0b2-46aa-a4ba-5c7520b6dc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc99470-20f7-4051-8d23-90a6055b593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:10 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Volume 3ab3d071-1ae8-4cdc-971d-d7f8c5751022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022', 'volume_size': 1} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1547102662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab3d071-1ae8-4cdc-971d-d7f8c5751022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7856b0ba6b4dce887ebd58cd620390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:10Z,use_quota=True,user_id='bd122948bc7b4fe8b6e399f3b03c6051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Creating volume 3ab3d071-1ae8-4cdc-971d-d7f8c5751022 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:06:10 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:10 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022 1073741824 Jul 18 06:06:10 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:10 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022 1073741824" returned: 0 in 0.493s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:10 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022 Jul 18 06:06:10 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:10 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022" returned: 0 in 0.356s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc99470-20f7-4051-8d23-90a6055b593e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b204ab94-19f6-42d8-b8fa-c5abb185ba5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:10 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Volume volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022 (3ab3d071-1ae8-4cdc-971d-d7f8c5751022): created successfully Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b204ab94-19f6-42d8-b8fa-c5abb185ba5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Flow 'volume_create_manager' (7f25bd63-dde3-4422-b2cd-ed9db22147d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2bca46b8-fdaf-4df3-8d95-0e4e6f8db696 tempest-VolumesTransfersV357Test-1535110525 None] Created volume successfully. Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Flow 'volume_create_manager' (a55b260a-5c58-4776-af2b-461868b152eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014e60be-0148-4050-8d1e-59a4e1a9c0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014e60be-0148-4050-8d1e-59a4e1a9c0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1952224815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b98023-4515-448e-b438-8524c21e2899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bda1c1abf744fba4a8b618acb1b9d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:12Z,use_quota=True,user_id='197c7742794a4e3a86188b52352d5fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f724d8a-5fa6-457a-9c49-cd3b2303b7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f724d8a-5fa6-457a-9c49-cd3b2303b7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ce897a-9ba7-470f-bdb7-0fd8ed3e74c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ce897a-9ba7-470f-bdb7-0fd8ed3e74c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b98023-4515-448e-b438-8524c21e2899', 'volume_name': 'volume-c7b98023-4515-448e-b438-8524c21e2899', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4a6e00-ad0a-4265-9e7a-007d320a2c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4a6e00-ad0a-4265-9e7a-007d320a2c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649087ec-c83d-4e30-b1b4-87df04888a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Volume c7b98023-4515-448e-b438-8524c21e2899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b98023-4515-448e-b438-8524c21e2899', 'volume_size': 1} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1952224815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b98023-4515-448e-b438-8524c21e2899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bda1c1abf744fba4a8b618acb1b9d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:12Z,use_quota=True,user_id='197c7742794a4e3a86188b52352d5fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Creating volume c7b98023-4515-448e-b438-8524c21e2899 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:06:12 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c7b98023-4515-448e-b438-8524c21e2899 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:12 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c7b98023-4515-448e-b438-8524c21e2899 1073741824 Jul 18 06:06:12 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:12 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c7b98023-4515-448e-b438-8524c21e2899 1073741824" returned: 0 in 0.512s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c7b98023-4515-448e-b438-8524c21e2899 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:12 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c7b98023-4515-448e-b438-8524c21e2899 Jul 18 06:06:12 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e6d55f69-58c5-4617-bb88-15ca858c53f4 tempest-VolumesTransfersV357Test-350240804 None] Transfer volume completed successfully. Jul 18 06:06:13 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c7b98023-4515-448e-b438-8524c21e2899" returned: 0 in 0.313s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649087ec-c83d-4e30-b1b4-87df04888a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b98023-4515-448e-b438-8524c21e2899', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19ac913-cbc0-42fd-8657-762b47b21b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:13 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Volume volume-c7b98023-4515-448e-b438-8524c21e2899 (c7b98023-4515-448e-b438-8524c21e2899): created successfully Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19ac913-cbc0-42fd-8657-762b47b21b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Flow 'volume_create_manager' (a55b260a-5c58-4776-af2b-461868b152eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c72c9da6-ae1f-4797-bab9-190b155d5ce3 tempest-VolumesListAdminTestJSON-1360570761 None] Created volume successfully. Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Acquiring lock "cinder-3ab3d071-1ae8-4cdc-971d-d7f8c5751022-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Lock "cinder-3ab3d071-1ae8-4cdc-971d-d7f8c5751022-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Acquiring lock "cinder-quobyte-3ab3d071-1ae8-4cdc-971d-d7f8c5751022" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Lock "cinder-quobyte-3ab3d071-1ae8-4cdc-971d-d7f8c5751022" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dce1863-2c20-4133-b0bf-d9c2c0fdd156]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:13 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022 Jul 18 06:06:13 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:13 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022" returned: 0 in 0.361s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:14 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022 Jul 18 06:06:14 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:14 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3ab3d071-1ae8-4cdc-971d-d7f8c5751022" returned: 0 in 0.285s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Lock "cinder-quobyte-3ab3d071-1ae8-4cdc-971d-d7f8c5751022" released by "delete_volume" :: held 0.688s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Created reservations ['ebe442c8-3c43-4345-82f3-384cc47b7fb9', 'd4c3f99e-ee6f-444a-9a7e-55b26f6906fe', '27018c8f-3e74-4157-bae3-f52e72dee6b7', 'c7c1c3fb-d51a-4e2f-ba2c-bf91c4d921b2'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:14 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:06:14 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:14 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.288s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:06:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Deleted volume successfully. Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e2792782-63fa-478e-bb01-62d808fbe170 tempest-VolumesTransfersV357Test-1905086134 None] Lock "cinder-3ab3d071-1ae8-4cdc-971d-d7f8c5751022-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1b801edd-15cb-4abb-a0d9-e77bb25de378 tempest-GroupsV320Test-1220775 None] Group tempest-GroupsV320Test-Group-870600512: creating Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Flow 'volume_create_manager' (f379a80d-d4c1-424c-ac15-702ddddf6b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f69d2d-67a7-4563-9b82-2eacc4f53e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f69d2d-67a7-4563-9b82-2eacc4f53e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1771318435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45a00d0-bb8e-41f0-8b84-1b2129fde786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bda1c1abf744fba4a8b618acb1b9d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:15Z,use_quota=True,user_id='197c7742794a4e3a86188b52352d5fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce4ade1-7de1-40cf-b566-8e8d372edac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce4ade1-7de1-40cf-b566-8e8d372edac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9632de2-75eb-4b1e-b79e-3828144d2019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9632de2-75eb-4b1e-b79e-3828144d2019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f45a00d0-bb8e-41f0-8b84-1b2129fde786', 'volume_name': 'volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7ada92-6bf9-4a9e-a35f-67814d6a6380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7ada92-6bf9-4a9e-a35f-67814d6a6380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7694ab-b25c-4de4-a00a-b4d6b60dc962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:14 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Volume f45a00d0-bb8e-41f0-8b84-1b2129fde786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786', 'volume_size': 1} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1771318435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45a00d0-bb8e-41f0-8b84-1b2129fde786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bda1c1abf744fba4a8b618acb1b9d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:15Z,use_quota=True,user_id='197c7742794a4e3a86188b52352d5fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Creating volume f45a00d0-bb8e-41f0-8b84-1b2129fde786 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:06:14 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:06:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1b801edd-15cb-4abb-a0d9-e77bb25de378 tempest-GroupsV320Test-1220775 None] Group tempest-GroupsV320Test-Group-870600512: created successfully Jul 18 06:06:14 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786 1073741824 Jul 18 06:06:14 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1b801edd-15cb-4abb-a0d9-e77bb25de378 tempest-GroupsV320Test-1220775 None] Create group completed successfully. Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Flow 'volume_create_manager' (1db3aaa3-160c-4af3-964c-e4e11b47202b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5cc717-1783-4380-870b-3b582f27c235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5cc717-1783-4380-870b-3b582f27c235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1145369463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2222f20b-fd01-466f-a4c3-f753e302df27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7856b0ba6b4dce887ebd58cd620390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:15Z,use_quota=True,user_id='bd122948bc7b4fe8b6e399f3b03c6051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3934df5-cef9-4d06-9602-0858e08d5b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3934df5-cef9-4d06-9602-0858e08d5b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c3e60b-c406-47be-b08a-6a7f85a75353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c3e60b-c406-47be-b08a-6a7f85a75353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2222f20b-fd01-466f-a4c3-f753e302df27', 'volume_name': 'volume-2222f20b-fd01-466f-a4c3-f753e302df27', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1410f4-cad8-4d0e-b9d1-e26c0a7a04e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1410f4-cad8-4d0e-b9d1-e26c0a7a04e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47aa64b-9d69-4162-8e75-0de15865ddd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:15 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Volume 2222f20b-fd01-466f-a4c3-f753e302df27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2222f20b-fd01-466f-a4c3-f753e302df27', 'volume_size': 1} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:15 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786 1073741824" returned: 0 in 0.463s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:15 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786 Jul 18 06:06:15 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:15 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1145369463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2222f20b-fd01-466f-a4c3-f753e302df27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7856b0ba6b4dce887ebd58cd620390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:15Z,use_quota=True,user_id='bd122948bc7b4fe8b6e399f3b03c6051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Creating volume 2222f20b-fd01-466f-a4c3-f753e302df27 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:06:15 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2222f20b-fd01-466f-a4c3-f753e302df27 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:15 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2222f20b-fd01-466f-a4c3-f753e302df27 1073741824 Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7694ab-b25c-4de4-a00a-b4d6b60dc962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:15 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa060d89-5f62-47e4-b7d1-7f2eb3fd3f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:15 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Volume volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786 (f45a00d0-bb8e-41f0-8b84-1b2129fde786): created successfully Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa060d89-5f62-47e4-b7d1-7f2eb3fd3f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Flow 'volume_create_manager' (f379a80d-d4c1-424c-ac15-702ddddf6b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4a6b74dd-e5c1-40d1-9114-4e9d1b83f10e tempest-VolumesListAdminTestJSON-1360570761 None] Created volume successfully. Jul 18 06:06:16 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2222f20b-fd01-466f-a4c3-f753e302df27 1073741824" returned: 0 in 0.488s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2222f20b-fd01-466f-a4c3-f753e302df27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:16 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2222f20b-fd01-466f-a4c3-f753e302df27 Jul 18 06:06:16 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-18dca5a0-025e-4bff-85dc-8791047eb8a2 tempest-GroupsV320Test-1220775 None] Created reservations ['9928c109-2fd8-4692-ac0b-06c6de8a4c03'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-18dca5a0-025e-4bff-85dc-8791047eb8a2 tempest-GroupsV320Test-1220775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-18dca5a0-025e-4bff-85dc-8791047eb8a2 tempest-GroupsV320Test-1220775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-18dca5a0-025e-4bff-85dc-8791047eb8a2 tempest-GroupsV320Test-1220775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-18dca5a0-025e-4bff-85dc-8791047eb8a2 tempest-GroupsV320Test-1220775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-18dca5a0-025e-4bff-85dc-8791047eb8a2 tempest-GroupsV320Test-1220775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-18dca5a0-025e-4bff-85dc-8791047eb8a2 tempest-GroupsV320Test-1220775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:16 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:06:16 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:16 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2222f20b-fd01-466f-a4c3-f753e302df27" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47aa64b-9d69-4162-8e75-0de15865ddd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2222f20b-fd01-466f-a4c3-f753e302df27', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6890cdf-e15d-45a0-a438-86987cdafeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Volume volume-2222f20b-fd01-466f-a4c3-f753e302df27 (2222f20b-fd01-466f-a4c3-f753e302df27): created successfully Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6890cdf-e15d-45a0-a438-86987cdafeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Flow 'volume_create_manager' (1db3aaa3-160c-4af3-964c-e4e11b47202b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4c32f650-5ee6-4103-a7ff-f3ca7585391c tempest-VolumesTransfersV357Test-1535110525 None] Created volume successfully. Jul 18 06:06:16 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-18dca5a0-025e-4bff-85dc-8791047eb8a2 tempest-GroupsV320Test-1220775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.248s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:16 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-18dca5a0-025e-4bff-85dc-8791047eb8a2 tempest-GroupsV320Test-1220775 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:06:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-18dca5a0-025e-4bff-85dc-8791047eb8a2 tempest-GroupsV320Test-1220775 None] Delete group completed successfully. Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Flow 'volume_create_manager' (79197c4e-7cc6-4940-a95f-ed75328a9d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b29ff84-2e0f-41ec-8e46-b5cf04c660a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b29ff84-2e0f-41ec-8e46-b5cf04c660a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1874714442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c3dcf9-56a8-4662-8212-705fe6459da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bda1c1abf744fba4a8b618acb1b9d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:17Z,use_quota=True,user_id='197c7742794a4e3a86188b52352d5fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d0dcf2-8ade-4b3d-8688-a4b953f6d985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d0dcf2-8ade-4b3d-8688-a4b953f6d985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b18773-3d9d-4d05-8367-7f0cac41b16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b18773-3d9d-4d05-8367-7f0cac41b16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c3dcf9-56a8-4662-8212-705fe6459da7', 'volume_name': 'volume-60c3dcf9-56a8-4662-8212-705fe6459da7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba8dc74-c707-46fc-a20b-756d1e9439a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba8dc74-c707-46fc-a20b-756d1e9439a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657a32c9-ebcf-4ff5-9183-4c098ad7dc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:17 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Volume 60c3dcf9-56a8-4662-8212-705fe6459da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c3dcf9-56a8-4662-8212-705fe6459da7', 'volume_size': 1} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1874714442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c3dcf9-56a8-4662-8212-705fe6459da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63bda1c1abf744fba4a8b618acb1b9d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:17Z,use_quota=True,user_id='197c7742794a4e3a86188b52352d5fd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Creating volume 60c3dcf9-56a8-4662-8212-705fe6459da7 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:06:17 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-60c3dcf9-56a8-4662-8212-705fe6459da7 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:17 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-60c3dcf9-56a8-4662-8212-705fe6459da7 1073741824 Jul 18 06:06:17 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Acquiring lock "cinder-2222f20b-fd01-466f-a4c3-f753e302df27-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Lock "cinder-2222f20b-fd01-466f-a4c3-f753e302df27-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Acquiring lock "cinder-quobyte-2222f20b-fd01-466f-a4c3-f753e302df27" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Lock "cinder-quobyte-2222f20b-fd01-466f-a4c3-f753e302df27" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa042287-1e8a-4997-8a68-aef466eabc2e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2222f20b-fd01-466f-a4c3-f753e302df27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:17 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-60c3dcf9-56a8-4662-8212-705fe6459da7 1073741824" returned: 0 in 0.550s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:17 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2222f20b-fd01-466f-a4c3-f753e302df27 Jul 18 06:06:17 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-60c3dcf9-56a8-4662-8212-705fe6459da7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:17 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-60c3dcf9-56a8-4662-8212-705fe6459da7 Jul 18 06:06:17 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:18 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2222f20b-fd01-466f-a4c3-f753e302df27" returned: 0 in 0.409s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2222f20b-fd01-466f-a4c3-f753e302df27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:18 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-60c3dcf9-56a8-4662-8212-705fe6459da7" returned: 0 in 0.274s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:18 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2222f20b-fd01-466f-a4c3-f753e302df27 Jul 18 06:06:18 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657a32c9-ebcf-4ff5-9183-4c098ad7dc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c3dcf9-56a8-4662-8212-705fe6459da7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376ead79-1817-431c-9158-4988b5ec0eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:18 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Volume volume-60c3dcf9-56a8-4662-8212-705fe6459da7 (60c3dcf9-56a8-4662-8212-705fe6459da7): created successfully Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376ead79-1817-431c-9158-4988b5ec0eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Flow 'volume_create_manager' (79197c4e-7cc6-4940-a95f-ed75328a9d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f8e181dd-04c3-4cc8-9ed6-8ac3647e7a40 tempest-VolumesListAdminTestJSON-1360570761 None] Created volume successfully. Jul 18 06:06:18 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2222f20b-fd01-466f-a4c3-f753e302df27" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Lock "cinder-quobyte-2222f20b-fd01-466f-a4c3-f753e302df27" released by "delete_volume" :: held 0.715s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Created reservations ['66d363e7-aab0-4540-88c2-fac65facf0d9', 'bce862e4-7a82-48d1-ae6c-7173e8e1e6f1', '4a851ebf-cca8-45ef-9e24-46de5ae546b5', 'c1139dee-c64a-46bb-b9ac-f9f285572a97'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:18 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:06:18 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:18 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:06:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Deleted volume successfully. Jul 18 06:06:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5e44e077-a64e-4e8c-9942-0bd0fd7c83a0 tempest-VolumesTransfersV357Test-1905086134 None] Lock "cinder-2222f20b-fd01-466f-a4c3-f753e302df27-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Flow 'volume_create_manager' (dfcda4f7-9335-450e-919e-292d6e60c49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9b3ca2-e62a-48c9-9bf8-93dca6ff9baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c9b3ca2-e62a-48c9-9bf8-93dca6ff9baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4118c18f-17d4-4095-9fc9-eddf86df3d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5dddb37132d4440b165e62e9da3047f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:21Z,use_quota=True,user_id='406871957acf431b8e5decd5f1c3e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af5fb5d-ef20-49f0-adc6-f70796e2cf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af5fb5d-ef20-49f0-adc6-f70796e2cf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dff012a-c289-44ab-93d1-9a3cac5b31f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dff012a-c289-44ab-93d1-9a3cac5b31f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4118c18f-17d4-4095-9fc9-eddf86df3d4c', 'volume_name': 'volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff58f5e4-3e8e-4122-860a-57b92260197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff58f5e4-3e8e-4122-860a-57b92260197c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73bf836f-637f-4cf4-ab6a-244b59e9c97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Volume 4118c18f-17d4-4095-9fc9-eddf86df3d4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c', 'volume_size': 1} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4118c18f-17d4-4095-9fc9-eddf86df3d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5dddb37132d4440b165e62e9da3047f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:21Z,use_quota=True,user_id='406871957acf431b8e5decd5f1c3e3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Creating volume 4118c18f-17d4-4095-9fc9-eddf86df3d4c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:06:20 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:06:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:20 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c 1073741824 Jul 18 06:06:20 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:21 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c 1073741824" returned: 0 in 0.580s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:21 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c Jul 18 06:06:21 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:21 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c" returned: 0 in 0.289s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:06:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73bf836f-637f-4cf4-ab6a-244b59e9c97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8aeb60e-816b-4f59-8188-448d86fc2a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Volume volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c (4118c18f-17d4-4095-9fc9-eddf86df3d4c): created successfully Jul 18 06:06:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8aeb60e-816b-4f59-8188-448d86fc2a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Flow 'volume_create_manager' (dfcda4f7-9335-450e-919e-292d6e60c49d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-83e37c0d-24ef-4fd3-b494-7cd6bcf245d7 tempest-VolumesListAdminTestJSON-1164169431 None] Created volume successfully. Jul 18 06:06:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Acquiring lock "cinder-4118c18f-17d4-4095-9fc9-eddf86df3d4c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Lock "cinder-4118c18f-17d4-4095-9fc9-eddf86df3d4c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Acquiring lock "cinder-quobyte-4118c18f-17d4-4095-9fc9-eddf86df3d4c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Lock "cinder-quobyte-4118c18f-17d4-4095-9fc9-eddf86df3d4c" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "cinder-60c3dcf9-56a8-4662-8212-705fe6459da7-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f99056-9525-46a2-bb45-a0b0936d5379]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "cinder-60c3dcf9-56a8-4662-8212-705fe6459da7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "cinder-quobyte-60c3dcf9-56a8-4662-8212-705fe6459da7" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "cinder-quobyte-60c3dcf9-56a8-4662-8212-705fe6459da7" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac59729c-abb1-4e2f-83f5-31f3ed5ec5da]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-60c3dcf9-56a8-4662-8212-705fe6459da7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:23 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c Jul 18 06:06:23 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:23 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-60c3dcf9-56a8-4662-8212-705fe6459da7 Jul 18 06:06:23 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:23 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c" returned: 0 in 0.492s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:23 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c Jul 18 06:06:23 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:23 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-60c3dcf9-56a8-4662-8212-705fe6459da7" returned: 0 in 0.611s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-60c3dcf9-56a8-4662-8212-705fe6459da7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:23 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-60c3dcf9-56a8-4662-8212-705fe6459da7 Jul 18 06:06:23 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:24 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4118c18f-17d4-4095-9fc9-eddf86df3d4c" returned: 0 in 0.445s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Lock "cinder-quobyte-4118c18f-17d4-4095-9fc9-eddf86df3d4c" released by "delete_volume" :: held 1.030s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Created reservations ['714b4cb8-8487-42b3-910b-9be8ae6ab6c7', 'c514016c-5103-48bd-9d91-9fd9daac6ae0', 'eb6fd3ca-404b-483c-919d-84a279121604', '49f04c9f-d141-4d83-a253-ab3ea7af0b81'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:24 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-60c3dcf9-56a8-4662-8212-705fe6459da7" returned: 0 in 0.492s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:24 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:06:24 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "cinder-quobyte-60c3dcf9-56a8-4662-8212-705fe6459da7" released by "delete_volume" :: held 1.173s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Flow 'volume_create_manager' (108cde9f-f81d-4f88-a6f1-134f85da4b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488278f8-ecb6-476b-9429-b4a3bfe57317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488278f8-ecb6-476b-9429-b4a3bfe57317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-147415665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b593bd41-6f6d-4174-bd9c-42f4e197a4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb90812fb7b640c7815c9a1f6126a966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:24Z,use_quota=True,user_id='5764abb4f25c42488032f27c3f51110f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db94b55-347a-43ee-9940-fa073463cbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db94b55-347a-43ee-9940-fa073463cbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef096a33-8029-403f-9738-70f0b13830c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef096a33-8029-403f-9738-70f0b13830c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b593bd41-6f6d-4174-bd9c-42f4e197a4be', 'volume_name': 'volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a065651-3092-4a1b-9a02-92f1e73d4064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a065651-3092-4a1b-9a02-92f1e73d4064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4e69e9-1c41-408c-98d4-97d15dc44477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:24 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Volume b593bd41-6f6d-4174-bd9c-42f4e197a4be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be', 'volume_size': 1} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-147415665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b593bd41-6f6d-4174-bd9c-42f4e197a4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb90812fb7b640c7815c9a1f6126a966',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:24Z,use_quota=True,user_id='5764abb4f25c42488032f27c3f51110f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Creating volume b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:06:24 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:24 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be 1073741824 Jul 18 06:06:24 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Created reservations ['aa4ef396-f84a-4fff-822a-1d11a2f23457', 'a09c7e9d-3324-4dff-b4c9-4b0c752b59c5', 'f9589c49-4005-4357-a2e9-622ad89c4545', 'd5ec3277-d970-4a4e-a136-079e4930b637'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:24 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.445s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:06:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Deleted volume successfully. Jul 18 06:06:24 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:06:24 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ba423c7-c352-4bfe-b58f-13c501fb8e46 tempest-VolumesListAdminTestJSON-1164169431 None] Lock "cinder-4118c18f-17d4-4095-9fc9-eddf86df3d4c-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:25 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.384s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:06:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Deleted volume successfully. Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-db59f3f3-e206-456e-acf6-045633ff75f0 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "cinder-60c3dcf9-56a8-4662-8212-705fe6459da7-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:25 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be 1073741824" returned: 0 in 0.729s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:25 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be Jul 18 06:06:25 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "cinder-f45a00d0-bb8e-41f0-8b84-1b2129fde786-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Lock "cinder-f45a00d0-bb8e-41f0-8b84-1b2129fde786-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:25 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be" returned: 0 in 0.290s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be4e69e9-1c41-408c-98d4-97d15dc44477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22003e7-e84d-4068-aaed-e1d4bc3f16d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "cinder-quobyte-f45a00d0-bb8e-41f0-8b84-1b2129fde786" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Volume volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be (b593bd41-6f6d-4174-bd9c-42f4e197a4be): created successfully Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22003e7-e84d-4068-aaed-e1d4bc3f16d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Flow 'volume_create_manager' (108cde9f-f81d-4f88-a6f1-134f85da4b5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Lock "cinder-quobyte-f45a00d0-bb8e-41f0-8b84-1b2129fde786" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-65882a63-ccd3-4b73-a383-97e638259cc7 tempest-SnapshotsActionsTest-692245341 None] Created volume successfully. Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5389cc-56c3-47f1-a7fa-7721f92b4a92]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:25 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786 Jul 18 06:06:25 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:26 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786" returned: 0 in 0.435s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:26 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786 Jul 18 06:06:26 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:26 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f45a00d0-bb8e-41f0-8b84-1b2129fde786" returned: 0 in 0.401s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-23138876-a15d-4984-b487-80d45c8635ca req-7dd73769-4566-49c9-9274-d446dc7e1f6b tempest-TestMinimumBasicScenario-1400255656 None] Terminate volume connection completed successfully. Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-23138876-a15d-4984-b487-80d45c8635ca req-7dd73769-4566-49c9-9274-d446dc7e1f6b tempest-TestMinimumBasicScenario-1400255656 None] Deleting attachment 5f1f8024-665d-4b31-9a3c-0d40c6b586cd. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Lock "cinder-quobyte-f45a00d0-bb8e-41f0-8b84-1b2129fde786" released by "delete_volume" :: held 0.906s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] Creating offline snapshot 532ffe78-0c80-4ee8-9e11-3f111670a99a of volume b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Created reservations ['8f00dc74-7878-425c-b91f-d76f18551bcd', '9c5bc0cc-c052-49c0-942d-e55291ad7211', 'dcf85f53-00e5-49b1-a0aa-8ca816853ed9', 'f2457a90-ba20-4fdd-9c33-e87d33c2e43e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[49970933-f87f-4c29-b76d-c7cb153ffecc]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:26 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be Jul 18 06:06:26 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:26 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:06:26 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:27 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.334s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:06:27 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Deleted volume successfully. Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4036cd7d-bfbf-46ae-8e13-07d64852200d tempest-VolumesListAdminTestJSON-1360570761 None] Lock "cinder-f45a00d0-bb8e-41f0-8b84-1b2129fde786-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:27 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be" returned: 0 in 0.581s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:27 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a 1G Jul 18 06:06:27 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Acquiring lock "cinder-35014d16-a83f-472d-9a12-be4a37d2d7ee-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Lock "cinder-35014d16-a83f-472d-9a12-be4a37d2d7ee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Acquiring lock "cinder-quobyte-35014d16-a83f-472d-9a12-be4a37d2d7ee" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Lock "cinder-quobyte-35014d16-a83f-472d-9a12-be4a37d2d7ee" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eec9326-2dad-4ba0-b066-66ef0b124704]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-35014d16-a83f-472d-9a12-be4a37d2d7ee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:27 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-35014d16-a83f-472d-9a12-be4a37d2d7ee Jul 18 06:06:27 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:27 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a 1G" returned: 0 in 0.508s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:27 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:06:27 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "cinder-c7b98023-4515-448e-b438-8524c21e2899-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "cinder-c7b98023-4515-448e-b438-8524c21e2899-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "cinder-quobyte-c7b98023-4515-448e-b438-8524c21e2899" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "cinder-quobyte-c7b98023-4515-448e-b438-8524c21e2899" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ba7141-f80d-416e-82df-ab6532475e86]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:28 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c7b98023-4515-448e-b438-8524c21e2899 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-35014d16-a83f-472d-9a12-be4a37d2d7ee" returned: 0 in 0.649s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-35014d16-a83f-472d-9a12-be4a37d2d7ee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:28 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:28 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-35014d16-a83f-472d-9a12-be4a37d2d7ee Jul 18 06:06:28 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.455s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:28 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a is being set with open permissions: ugo+rw Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:28 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:06:28 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:28 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c7b98023-4515-448e-b438-8524c21e2899 Jul 18 06:06:28 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:28 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:28 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.298s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-35014d16-a83f-472d-9a12-be4a37d2d7ee" returned: 0 in 0.348s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Lock "cinder-quobyte-35014d16-a83f-472d-9a12-be4a37d2d7ee" released by "delete_volume" :: held 1.070s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:28 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c7b98023-4515-448e-b438-8524c21e2899" returned: 0 in 0.416s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c7b98023-4515-448e-b438-8524c21e2899 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:28 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c7b98023-4515-448e-b438-8524c21e2899 Jul 18 06:06:28 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:28 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.info Jul 18 06:06:28 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Created reservations ['5fb741d6-9791-46d5-b4b2-5b1ea1ffbf7e', 'e419e202-a070-4da4-9aaf-3770c199da83', 'e00d01b9-47a4-45d6-bd6b-ca906661d0be', '1cdb8781-d1b3-423e-bcc0-c853b4cb6e87'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:28 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:06:28 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:28 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c7b98023-4515-448e-b438-8524c21e2899" returned: 0 in 0.303s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "cinder-quobyte-c7b98023-4515-448e-b438-8524c21e2899" released by "delete_volume" :: held 0.781s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:29 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.info" returned: 0 in 0.336s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:29 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.info is being set with open permissions: ugo+rw Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:29 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.info Jul 18 06:06:29 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Created reservations ['ac146b2e-8165-4596-a320-6cbb9c847d92', 'f93bbccd-baa4-4cc3-8d53-508f8baa8b6d', 'd3969560-4696-41ae-9c0c-25a0228b26f5', 'aec90c2f-1e04-42ec-9866-1502cfd59153'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:29 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.308s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:06:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Deleted volume successfully. Jul 18 06:06:29 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:06:29 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-62b4c5d3-a0e6-4120-80fa-8380ce4f5553 tempest-TestMinimumBasicScenario-1400255656 None] Lock "cinder-35014d16-a83f-472d-9a12-be4a37d2d7ee-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:29 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.info" returned: 0 in 0.332s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.685s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-face7ba4-c793-46c3-b781-0656f61ea0d6 tempest-SnapshotsActionsTest-692245341 None] Create snapshot completed successfully Jul 18 06:06:29 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.313s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:06:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Deleted volume successfully. Jul 18 06:06:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9809f77c-ecdd-4bec-993c-89a7094701c1 tempest-VolumesListAdminTestJSON-1360570761 None] Lock "cinder-c7b98023-4515-448e-b438-8524c21e2899-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] Creating offline snapshot 9d3355fa-1cef-42d1-b050-aadc0f833ce3 of volume b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:06:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[833d34f9-b5cd-4feb-aee1-69a04799d258]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:31 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:06:31 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:31 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.485s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:06:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:31 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 1G Jul 18 06:06:31 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:31 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 1G" returned: 0 in 0.522s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:31 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 Jul 18 06:06:31 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:32 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3" returned: 0 in 0.503s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:32 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 is being set with open permissions: ugo+rw Jul 18 06:06:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:32 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 Jul 18 06:06:32 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:32 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3" returned: 0 in 0.310s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:32 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-94d167f2-fbcb-496c-af37-69307f7175b4 tempest-SnapshotsActionsTest-692245341 None] Create snapshot completed successfully Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Acquiring lock "cinder-9d3355fa-1cef-42d1-b050-aadc0f833ce3-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-9d3355fa-1cef-42d1-b050-aadc0f833ce3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Acquiring lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Acquiring lock "cinder-quobyte-9d3355fa-1cef-42d1-b050-aadc0f833ce3" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-9d3355fa-1cef-42d1-b050-aadc0f833ce3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Deleting offline snapshot 9d3355fa-1cef-42d1-b050-aadc0f833ce3 of volume b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] snapshot_file for this snap is: volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bbaf36-6a01-41c7-a27d-a1fd5e1fdb71]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:33 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 Jul 18 06:06:33 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:33 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3" returned: 0 in 0.493s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f2ca9-293d-4426-9816-fc68c27a9b26]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:33 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:06:33 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:34 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.549s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:06:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:34 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 Jul 18 06:06:34 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:34 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3" returned: 0 in 0.475s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:34 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3 Jul 18 06:06:34 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:35 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:06:35 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:35 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.9d3355fa-1cef-42d1-b050-aadc0f833ce3" returned: 0 in 0.465s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-9d3355fa-1cef-42d1-b050-aadc0f833ce3" released by "_delete_snapshot" :: held 2.156s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" released by "delete_snapshot" :: held 2.189s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Created reservations ['fae6d5fd-cbf0-40b2-a4c7-01d87ba6aea1', '400af8d4-677a-4b09-add3-861137e70285', '8afe8987-3681-43dc-b2c4-d2a376dd0e87', '144fb294-88df-42d1-87cb-ce6efa1dc451'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:35 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Delete snapshot completed successfully. Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-93ec21b6-415b-45a5-80ba-dec999cfeb6a tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-9d3355fa-1cef-42d1-b050-aadc0f833ce3-delete_snapshot" released by "delete_snapshot" :: held 2.397s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:06:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:06:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] Creating offline snapshot c826ad97-d0fd-4216-a54d-04190eb53909 of volume b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:06:36 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bea46a5-f33d-4c15-8066-e651a1c2497b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:37 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:06:37 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:37 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.443s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:06:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:37 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 1G Jul 18 06:06:37 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:37 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 1G" returned: 0 in 0.583s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:38 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 Jul 18 06:06:38 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:38 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909" returned: 0 in 0.460s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:38 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 is being set with open permissions: ugo+rw Jul 18 06:06:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:38 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 Jul 18 06:06:38 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:38 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909" returned: 0 in 0.346s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-15ce03f7-47e2-44fb-b179-29374cc8fc96 tempest-SnapshotsActionsTest-692245341 None] Create snapshot completed successfully Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Flow 'volume_create_manager' (de5e0c9e-68d5-4268-b1bb-f36748cefbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd90f2e-27e1-44ac-aa22-0e165a356632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd90f2e-27e1-44ac-aa22-0e165a356632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824111959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba634d55-a144-4c71-8993-729ea0910906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53b51d4e1cc43a9a9b1ff0c8e5cb920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:39Z,use_quota=True,user_id='c095c57838ab42b28cc920eb2c9e97ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ce6ba7-e815-465a-96a0-05538aa023fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ce6ba7-e815-465a-96a0-05538aa023fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27bf2fc-23d7-4345-9c06-296f00690020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c27bf2fc-23d7-4345-9c06-296f00690020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba634d55-a144-4c71-8993-729ea0910906', 'volume_name': 'volume-ba634d55-a144-4c71-8993-729ea0910906', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35a042c-3187-4435-b8fc-0ee4907ebef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35a042c-3187-4435-b8fc-0ee4907ebef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc48e95-4e30-4e15-8587-d951b3c64d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Volume ba634d55-a144-4c71-8993-729ea0910906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba634d55-a144-4c71-8993-729ea0910906', 'volume_size': 1} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824111959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba634d55-a144-4c71-8993-729ea0910906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53b51d4e1cc43a9a9b1ff0c8e5cb920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:39Z,use_quota=True,user_id='c095c57838ab42b28cc920eb2c9e97ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Creating volume ba634d55-a144-4c71-8993-729ea0910906 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:06:39 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:39 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 1073741824 Jul 18 06:06:39 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:39 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 1073741824" returned: 0 in 0.481s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:39 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 Jul 18 06:06:39 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Acquiring lock "cinder-c826ad97-d0fd-4216-a54d-04190eb53909-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-c826ad97-d0fd-4216-a54d-04190eb53909-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Acquiring lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Acquiring lock "cinder-quobyte-c826ad97-d0fd-4216-a54d-04190eb53909" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:40 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906" returned: 0 in 0.303s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc48e95-4e30-4e15-8587-d951b3c64d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba634d55-a144-4c71-8993-729ea0910906', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4de165d-3bf6-4def-8c00-eece8cc9561a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-c826ad97-d0fd-4216-a54d-04190eb53909" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Deleting offline snapshot c826ad97-d0fd-4216-a54d-04190eb53909 of volume b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] snapshot_file for this snap is: volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4646003c-f90c-4e76-92d9-8e69d6972233]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Volume volume-ba634d55-a144-4c71-8993-729ea0910906 (ba634d55-a144-4c71-8993-729ea0910906): created successfully Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4de165d-3bf6-4def-8c00-eece8cc9561a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Flow 'volume_create_manager' (de5e0c9e-68d5-4268-b1bb-f36748cefbdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3dff5f53-583a-4ba7-87a1-fdcf4fd31830 tempest-VolumesActionsTest-1352839993 None] Created volume successfully. Jul 18 06:06:40 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 Jul 18 06:06:40 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:40 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909" returned: 0 in 0.473s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90c67b9-715c-410a-a201-e694f72c7fee]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:40 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:06:40 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:41 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.399s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:41 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 Jul 18 06:06:41 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Flow 'volume_create_manager' (c47c0d8c-41dc-410b-8bec-3a4d24a1b375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e13cbf-bb6d-4763-9e5f-d533c3407870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e13cbf-bb6d-4763-9e5f-d533c3407870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1854297130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ef972b-15e2-452a-bfd8-82681ad5e694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80feeb4b344a4fd09997a7214085aee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:42Z,use_quota=True,user_id='8f3b8d6588ad47f99f2c29a28fdac560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a68e65-0888-4216-9ea5-2b4447136eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a68e65-0888-4216-9ea5-2b4447136eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271cec5d-784b-450e-8ca8-0629d4cdacd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 06:06:41 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909" returned: 0 in 0.597s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:41 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909 Jul 18 06:06:41 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (271cec5d-784b-450e-8ca8-0629d4cdacd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65ef972b-15e2-452a-bfd8-82681ad5e694', 'volume_name': 'volume-65ef972b-15e2-452a-bfd8-82681ad5e694', 'volume_size': 1, 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56cf243eadf74e53add363d5f7382182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'created_at': datetime.datetime(2026, 7, 18, 3, 51, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 51, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fde147a-2811-4cb1-8bd9-9050ea5fd85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fde147a-2811-4cb1-8bd9-9050ea5fd85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb52c6d6-724b-4758-8fd4-9d0bc8f73735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:42 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Volume 65ef972b-15e2-452a-bfd8-82681ad5e694: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65ef972b-15e2-452a-bfd8-82681ad5e694', 'volume_size': 1, 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56cf243eadf74e53add363d5f7382182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'created_at': datetime.datetime(2026, 7, 18, 3, 51, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 51, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Trying to clone 65ef972b-15e2-452a-bfd8-82681ad5e694 from image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 06:06:42 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.c826ad97-d0fd-4216-a54d-04190eb53909" returned: 0 in 0.320s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-c826ad97-d0fd-4216-a54d-04190eb53909" released by "_delete_snapshot" :: held 1.946s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" released by "delete_snapshot" :: held 2.018s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Created reservations ['9e2159ba-3349-4567-b6ca-184e2d82a6b8', '601badca-c03b-40e8-a69d-738761d2f14a', '095efd3e-087a-44dc-8b77-1dc2a0f9b9fd', '4f42952b-dc62-4c82-8b39-0c19b2c5a794'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 06:06:42 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Image download 20.69 MB at 20.69 MB/s Jul 18 06:06:42 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Delete snapshot completed successfully. Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a95fa74b-dfa9-4eaa-bae3-6bdf3b77bf8f tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-c826ad97-d0fd-4216-a54d-04190eb53909-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa80e008-f592-443b-b65f-6d4f30f77a1a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:42 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD Jul 18 06:06:42 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:42 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Temporary image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a is fetched for user 8f3b8d6588ad47f99f2c29a28fdac560. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd58611-bfb1-47b9-8cb8-a217ff218a27]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:43 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD Jul 18 06:06:43 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:43 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1854297130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ef972b-15e2-452a-bfd8-82681ad5e694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80feeb4b344a4fd09997a7214085aee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:06:42Z,use_quota=True,user_id='8f3b8d6588ad47f99f2c29a28fdac560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Creating volume 65ef972b-15e2-452a-bfd8-82681ad5e694 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:06:43 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:43 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 1073741824 Jul 18 06:06:43 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:44 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 1073741824" returned: 0 in 0.712s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:44 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 Jul 18 06:06:44 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:44 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694" returned: 0 in 0.310s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:06:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.745s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] Creating offline snapshot 1524177b-2907-4503-98be-b82361b8841f of volume b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:06:44 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Attempting download of b5dcfdae-2c52-436e-9a7d-1ba63c90db8a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}])) to volume 65ef972b-15e2-452a-bfd8-82681ad5e694. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 06:06:44 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7082fa6d-c0d4-433f-bb3b-ec1386ff8c1f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:44 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[13179414-6dd5-41ea-8cb3-92d44a126b0b]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_s_ar7oeo {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:44 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:06:44 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:45 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_s_ar7oeo Jul 18 06:06:45 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:45 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.619s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:06:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:45 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f 1G Jul 18 06:06:45 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:45 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_s_ar7oeo" returned: 0 in 0.651s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_s_ar7oeo {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:45 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_s_ar7oeo Jul 18 06:06:45 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:46 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_s_ar7oeo" returned: 1 in 0.507s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_s_ar7oeo' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[700618c1-71af-49da-a02c-854c2404e807]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:46 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f 1G" returned: 0 in 0.649s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:46 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f Jul 18 06:06:46 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:46 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD Jul 18 06:06:46 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:46 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f" returned: 0 in 0.404s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:46 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f is being set with open permissions: ugo+rw Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:46 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f Jul 18 06:06:46 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:46 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD" returned: 0 in 0.500s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] b5dcfdae-2c52-436e-9a7d-1ba63c90db8a was qcow2, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:46 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 Jul 18 06:06:46 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:46 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-36053649-dc15-40a4-8ecf-dbfbd316cc6e tempest-SnapshotsActionsTest-692245341 None] Create snapshot completed successfully Jul 18 06:06:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Acquiring lock "cinder-1524177b-2907-4503-98be-b82361b8841f-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-1524177b-2907-4503-98be-b82361b8841f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Acquiring lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Acquiring lock "cinder-quobyte-1524177b-2907-4503-98be-b82361b8841f" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-1524177b-2907-4503-98be-b82361b8841f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Deleting offline snapshot 1524177b-2907-4503-98be-b82361b8841f of volume b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:06:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] snapshot_file for this snap is: volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:06:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5dc99c-a989-42b3-a705-ee7554be205e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:47 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f Jul 18 06:06:47 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:48 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f" returned: 0 in 0.996s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:06:48 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be48fbe-753d-418d-a293-6e2e57903087]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:48 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:06:48 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:49 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.649s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:06:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:49 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f Jul 18 06:06:49 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:50 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694" returned: 0 in 3.477s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_7mudi96ldevstack@QuobyteHD, size 112.00 MB, duration 3.48 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:06:50 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Converted 112.00 MB image at 32.16 MB/s Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:50 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 1G Jul 18 06:06:50 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:50 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f" returned: 0 in 0.960s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:50 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f Jul 18 06:06:50 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:50 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.1524177b-2907-4503-98be-b82361b8841f" returned: 0 in 0.498s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-1524177b-2907-4503-98be-b82361b8841f" released by "_delete_snapshot" :: held 3.281s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" released by "delete_snapshot" :: held 3.323s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:50 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 1G" returned: 0 in 0.705s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Downloaded image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}])) to volume 65ef972b-15e2-452a-bfd8-82681ad5e694 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Temporary image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a for user 8f3b8d6588ad47f99f2c29a28fdac560 is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Marking volume 65ef972b-15e2-452a-bfd8-82681ad5e694 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Copying metadata from image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a to 65ef972b-15e2-452a-bfd8-82681ad5e694. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Creating volume glance metadata for volume 65ef972b-15e2-452a-bfd8-82681ad5e694 backed by image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Created reservations ['71bbe437-64f1-4633-bba3-93968a3422db', '64214134-dee8-4bb9-917f-200b15f93328', '83b54e3a-f4ba-4f47-8a49-e435e5751f1f', 'c57b10dd-ccee-498e-a051-321f80e022b4'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Delete snapshot completed successfully. Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70dbb890-f469-4b4b-b589-959996452f87 tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-1524177b-2907-4503-98be-b82361b8841f-delete_snapshot" released by "delete_snapshot" :: held 3.636s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb52c6d6-724b-4758-8fd4-9d0bc8f73735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ef972b-15e2-452a-bfd8-82681ad5e694', 'volume_size': 1, 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56cf243eadf74e53add363d5f7382182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'created_at': datetime.datetime(2026, 7, 18, 3, 51, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 51, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152b890d-d41c-4aa9-b19a-06799bbe405a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Volume volume-65ef972b-15e2-452a-bfd8-82681ad5e694 (65ef972b-15e2-452a-bfd8-82681ad5e694): created successfully Jul 18 06:06:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152b890d-d41c-4aa9-b19a-06799bbe405a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Flow 'volume_create_manager' (c47c0d8c-41dc-410b-8bec-3a4d24a1b375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7899ee9b-a9c3-485f-a547-25b38dc1e040 tempest-VolumesImageMetadata-996536148 None] Created volume successfully. Jul 18 06:06:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9c99870e-1d6b-4ef0-bdfe-1ba4214949dc tempest-VolumesActionsTest-1352839993 None] Acquiring lock "cinder-ba634d55-a144-4c71-8993-729ea0910906" by "attach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9c99870e-1d6b-4ef0-bdfe-1ba4214949dc tempest-VolumesActionsTest-1352839993 None] Lock "cinder-ba634d55-a144-4c71-8993-729ea0910906" acquired by "attach_volume" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9c99870e-1d6b-4ef0-bdfe-1ba4214949dc tempest-VolumesActionsTest-1352839993 None] Attaching volume ba634d55-a144-4c71-8993-729ea0910906 to instance c76e285a-cc7a-4782-89b6-95a66d297842 at mountpoint /dev/vdb on host None. Jul 18 06:06:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9c99870e-1d6b-4ef0-bdfe-1ba4214949dc tempest-VolumesActionsTest-1352839993 None] Attach volume completed successfully. Jul 18 06:06:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9c99870e-1d6b-4ef0-bdfe-1ba4214949dc tempest-VolumesActionsTest-1352839993 None] Lock "cinder-ba634d55-a144-4c71-8993-729ea0910906" released by "attach_volume" :: held 0.149s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c151b994-af46-45b5-b133-ee4551d869a3 tempest-VolumesActionsTest-1352839993 None] Acquiring lock "cinder-ba634d55-a144-4c71-8993-729ea0910906-detach_volume" by "detach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c151b994-af46-45b5-b133-ee4551d869a3 tempest-VolumesActionsTest-1352839993 None] Lock "cinder-ba634d55-a144-4c71-8993-729ea0910906-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c151b994-af46-45b5-b133-ee4551d869a3 tempest-VolumesActionsTest-1352839993 None] Detaching volume ba634d55-a144-4c71-8993-729ea0910906 from instance c76e285a-cc7a-4782-89b6-95a66d297842. Jul 18 06:06:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c151b994-af46-45b5-b133-ee4551d869a3 tempest-VolumesActionsTest-1352839993 None] Detach volume completed successfully. Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c151b994-af46-45b5-b133-ee4551d869a3 tempest-VolumesActionsTest-1352839993 None] Lock "cinder-ba634d55-a144-4c71-8993-729ea0910906-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Acquiring lock "cinder-65ef972b-15e2-452a-bfd8-82681ad5e694-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Lock "cinder-65ef972b-15e2-452a-bfd8-82681ad5e694-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] Creating offline snapshot 78c3f35f-3081-4cbe-84e6-a4335af721f8 of volume b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Acquiring lock "cinder-quobyte-65ef972b-15e2-452a-bfd8-82681ad5e694" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[12706a32-2576-45bd-bbe2-2938451a79bf]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Lock "cinder-quobyte-65ef972b-15e2-452a-bfd8-82681ad5e694" acquired by "delete_volume" :: waited 0.049s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e0c4b4-2323-4992-bd06-67bb004a1043]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:52 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:06:52 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:52 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 Jul 18 06:06:52 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:53 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.648s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:53 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 1G Jul 18 06:06:53 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:53 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694" returned: 0 in 0.608s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:53 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694 Jul 18 06:06:53 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:53 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-65ef972b-15e2-452a-bfd8-82681ad5e694" returned: 0 in 0.357s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Lock "cinder-quobyte-65ef972b-15e2-452a-bfd8-82681ad5e694" released by "delete_volume" :: held 1.036s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Created reservations ['f69e9554-c016-43ac-b360-08ebe3862b94', '72006f35-11e6-4be6-9c21-b8baa5e06e45', '2a4a7c9b-1517-404d-b05c-1ee7f3071657', 'ccb129fa-e32d-4967-bcf7-6a662dcb506b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:53 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 1G" returned: 0 in 0.619s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:53 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:06:53 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:53 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 Jul 18 06:06:53 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:54 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.478s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:54 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:06:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Deleted volume successfully. Jul 18 06:06:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-690d6e5e-7f11-4580-ac5c-6ff37837380b tempest-VolumesImageMetadata-996536148 None] Lock "cinder-65ef972b-15e2-452a-bfd8-82681ad5e694-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:54 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8" returned: 0 in 0.530s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:54 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 is being set with open permissions: ugo+rw Jul 18 06:06:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:54 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 Jul 18 06:06:54 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:54 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8" returned: 0 in 0.300s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d2030b2f-b489-407a-bfe8-cda622731ab1 tempest-SnapshotsActionsTest-692245341 None] Create snapshot completed successfully Jul 18 06:06:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Acquiring lock "cinder-78c3f35f-3081-4cbe-84e6-a4335af721f8-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-78c3f35f-3081-4cbe-84e6-a4335af721f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Acquiring lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Acquiring lock "cinder-quobyte-78c3f35f-3081-4cbe-84e6-a4335af721f8" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-78c3f35f-3081-4cbe-84e6-a4335af721f8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Deleting offline snapshot 78c3f35f-3081-4cbe-84e6-a4335af721f8 of volume b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:06:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] snapshot_file for this snap is: volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:06:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6432c542-2ade-42c9-8252-3f515d06558e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:56 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 Jul 18 06:06:56 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:56 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8" returned: 0 in 0.464s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:06:56 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[76372f66-03a9-4512-9672-b652798bed86]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:06:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:56 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:06:56 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:56 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.506s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:06:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:57 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 Jul 18 06:06:57 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:57 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8" returned: 0 in 0.522s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:57 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8 Jul 18 06:06:57 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:57 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Jul 18 06:06:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.78c3f35f-3081-4cbe-84e6-a4335af721f8" returned: 0 in 0.369s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:06:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-78c3f35f-3081-4cbe-84e6-a4335af721f8" released by "_delete_snapshot" :: held 1.997s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" released by "delete_snapshot" :: held 2.038s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:58 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Created reservations ['f792bc1a-c3bd-4077-a44d-aa179438f715', '293a07ba-2eae-4b60-924d-5f008abfcc01', '1c0cf33b-2559-4ed9-945e-d6b205bef88c', '0766d670-8d16-4b9c-8379-556fe35cf188'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:06:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Delete snapshot completed successfully. Jul 18 06:06:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-95be4b85-8778-431d-9231-0f3f77a1e973 tempest-SnapshotsActionsTest-593138484 None] Lock "cinder-78c3f35f-3081-4cbe-84e6-a4335af721f8-delete_snapshot" released by "delete_snapshot" :: held 2.377s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Flow 'volume_create_manager' (0a946b3c-1eb7-4a3b-ad17-c775f10fbefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9001666f-28e4-4c56-9f70-c9bcd6c75f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9001666f-28e4-4c56-9f70-c9bcd6c75f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1305365324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e8083a-971e-4b63-ba6c-a005b7c30a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27db7a45961744459b1962edcf9ef9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:07:00Z,use_quota=True,user_id='30c5e809b898434da2c73918d9d7b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4851266c-abde-42c5-953c-658265fcd970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4851266c-abde-42c5-953c-658265fcd970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ebc43d-ff7e-4663-8c71-acbe58eee93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ebc43d-ff7e-4663-8c71-acbe58eee93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e8083a-971e-4b63-ba6c-a005b7c30a27', 'volume_name': 'volume-45e8083a-971e-4b63-ba6c-a005b7c30a27', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff141b0-a7eb-4ed7-bdf4-b7ffbb418605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff141b0-a7eb-4ed7-bdf4-b7ffbb418605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f686b9a4-ad3e-4cd6-9cea-19d4444415eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:06:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Volume 45e8083a-971e-4b63-ba6c-a005b7c30a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e8083a-971e-4b63-ba6c-a005b7c30a27', 'volume_size': 1} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1305365324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e8083a-971e-4b63-ba6c-a005b7c30a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27db7a45961744459b1962edcf9ef9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:07:00Z,use_quota=True,user_id='30c5e809b898434da2c73918d9d7b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Creating volume 45e8083a-971e-4b63-ba6c-a005b7c30a27 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:06:59 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-45e8083a-971e-4b63-ba6c-a005b7c30a27 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:06:59 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-45e8083a-971e-4b63-ba6c-a005b7c30a27 1073741824 Jul 18 06:06:59 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "cinder-532ffe78-0c80-4ee8-9e11-3f111670a99a-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Lock "cinder-532ffe78-0c80-4ee8-9e11-3f111670a99a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:06:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "cinder-quobyte-532ffe78-0c80-4ee8-9e11-3f111670a99a" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Lock "cinder-quobyte-532ffe78-0c80-4ee8-9e11-3f111670a99a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Deleting offline snapshot 532ffe78-0c80-4ee8-9e11-3f111670a99a of volume b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] snapshot_file for this snap is: volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54edd4c-2958-4293-ac7c-045d4e508383]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:00 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:07:00 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:00 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-45e8083a-971e-4b63-ba6c-a005b7c30a27 1073741824" returned: 0 in 0.672s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-45e8083a-971e-4b63-ba6c-a005b7c30a27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:00 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.470s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:07:00 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-45e8083a-971e-4b63-ba6c-a005b7c30a27 Jul 18 06:07:00 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ce25b6-cf86-4035-b5f5-f70fdea3db09]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:00 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be Jul 18 06:07:00 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:00 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-45e8083a-971e-4b63-ba6c-a005b7c30a27" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=118,cinder:INSERT=47,cinder:UPDATE=138,cinder:DELETE=17 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f686b9a4-ad3e-4cd6-9cea-19d4444415eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e8083a-971e-4b63-ba6c-a005b7c30a27', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d109fb25-621c-4a14-978e-aef9a6e6192d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:00 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Volume volume-45e8083a-971e-4b63-ba6c-a005b7c30a27 (45e8083a-971e-4b63-ba6c-a005b7c30a27): created successfully Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d109fb25-621c-4a14-978e-aef9a6e6192d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Flow 'volume_create_manager' (0a946b3c-1eb7-4a3b-ad17-c775f10fbefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:07:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f4957754-90a6-4985-851e-a15860c5f66c tempest-AbsoluteLimitsTests-1434562672 None] Created volume successfully. Jul 18 06:07:01 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be" returned: 0 in 0.482s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:01 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:07:01 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:01 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.435s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:01 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a Jul 18 06:07:01 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:01 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be.532ffe78-0c80-4ee8-9e11-3f111670a99a" returned: 0 in 0.324s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Acquiring lock "cinder-45e8083a-971e-4b63-ba6c-a005b7c30a27-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:07:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Lock "cinder-quobyte-532ffe78-0c80-4ee8-9e11-3f111670a99a" released by "_delete_snapshot" :: held 1.888s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" released by "delete_snapshot" :: held 1.937s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Lock "cinder-45e8083a-971e-4b63-ba6c-a005b7c30a27-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:07:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Acquiring lock "cinder-quobyte-45e8083a-971e-4b63-ba6c-a005b7c30a27" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:07:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Lock "cinder-quobyte-45e8083a-971e-4b63-ba6c-a005b7c30a27" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:07:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa88e60-4d7c-40bc-b033-3a2db10fe69c]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-45e8083a-971e-4b63-ba6c-a005b7c30a27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:02 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Created reservations ['baac4ff0-9a98-4383-a221-16adde1882be', 'f603815d-7d91-4c50-85a4-d41c0f3ae661', '3fc50136-82f4-4356-9298-175b1d17da25', '6430b51a-e4f9-41ce-bd6f-27774b1e80d5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:07:02 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-45e8083a-971e-4b63-ba6c-a005b7c30a27 Jul 18 06:07:02 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Delete snapshot completed successfully. Jul 18 06:07:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c0041d9d-e943-43d9-a06e-46337f78503c tempest-SnapshotsActionsTest-692245341 None] Lock "cinder-532ffe78-0c80-4ee8-9e11-3f111670a99a-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:02 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-45e8083a-971e-4b63-ba6c-a005b7c30a27" returned: 0 in 0.686s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-45e8083a-971e-4b63-ba6c-a005b7c30a27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:02 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-45e8083a-971e-4b63-ba6c-a005b7c30a27 Jul 18 06:07:02 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:03 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-45e8083a-971e-4b63-ba6c-a005b7c30a27" returned: 0 in 0.537s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Lock "cinder-quobyte-45e8083a-971e-4b63-ba6c-a005b7c30a27" released by "delete_volume" :: held 1.308s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Created reservations ['e02fca8c-29e5-4264-947e-ca7f1d62b3e5', '684a01e9-9937-4c39-b406-cbf7904d8707', '4b975e96-9e15-42cd-aedd-5dd0f92cd2b1', '896fa0ca-aa5c-4440-8b43-36113d9a602b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "cinder-b593bd41-6f6d-4174-bd9c-42f4e197a4be-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Lock "cinder-b593bd41-6f6d-4174-bd9c-42f4e197a4be-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:07:03 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:07:03 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" acquired by "delete_volume" :: waited 0.049s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c1160c-4de8-4108-83ac-6219a1c69971]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:04 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be Jul 18 06:07:04 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:04 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.629s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:04 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:07:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Deleted volume successfully. Jul 18 06:07:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3139ceff-aaae-492c-88a6-a28d92677148 tempest-AbsoluteLimitsTests-1434562672 None] Lock "cinder-45e8083a-971e-4b63-ba6c-a005b7c30a27-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:04 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be" returned: 0 in 0.775s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:04 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be Jul 18 06:07:04 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:05 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b593bd41-6f6d-4174-bd9c-42f4e197a4be" returned: 0 in 0.476s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Lock "cinder-quobyte-b593bd41-6f6d-4174-bd9c-42f4e197a4be" released by "delete_volume" :: held 1.367s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Created reservations ['b84fb46c-e0f8-40ca-b2e8-78dc0238baf3', '4bb13e83-40e3-4fa6-839a-f320feb3954e', '38f6775c-2d81-4aa3-a612-65083b55b4c2', '592e6b00-6a24-4198-8b1a-bebf232de346'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:05 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:07:05 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d4d908a-47bb-405a-afb1-811b2d0f6a24 tempest-VolumesActionsTest-1352839993 None] Acquiring lock "cinder-ba634d55-a144-4c71-8993-729ea0910906" by "attach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d4d908a-47bb-405a-afb1-811b2d0f6a24 tempest-VolumesActionsTest-1352839993 None] Lock "cinder-ba634d55-a144-4c71-8993-729ea0910906" acquired by "attach_volume" :: waited 0.037s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:07:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0d4d908a-47bb-405a-afb1-811b2d0f6a24 tempest-VolumesActionsTest-1352839993 None] Attaching volume ba634d55-a144-4c71-8993-729ea0910906 to instance daa3463b-adf4-403c-b71b-4660f3befe0d at mountpoint /dev/vdb on host None. Jul 18 06:07:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0d4d908a-47bb-405a-afb1-811b2d0f6a24 tempest-VolumesActionsTest-1352839993 None] Attach volume completed successfully. Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0d4d908a-47bb-405a-afb1-811b2d0f6a24 tempest-VolumesActionsTest-1352839993 None] Lock "cinder-ba634d55-a144-4c71-8993-729ea0910906" released by "attach_volume" :: held 0.180s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:05 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.442s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:07:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Deleted volume successfully. Jul 18 06:07:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1882b061-d984-4edd-a1c9-65eba90e5853 tempest-SnapshotsActionsTest-692245341 None] Lock "cinder-b593bd41-6f6d-4174-bd9c-42f4e197a4be-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2341cea5-bdb2-4730-a548-f8f6110e413e tempest-VolumesActionsTest-1352839993 None] Acquiring lock "cinder-ba634d55-a144-4c71-8993-729ea0910906-detach_volume" by "detach_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:07:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2341cea5-bdb2-4730-a548-f8f6110e413e tempest-VolumesActionsTest-1352839993 None] Lock "cinder-ba634d55-a144-4c71-8993-729ea0910906-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:07:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2341cea5-bdb2-4730-a548-f8f6110e413e tempest-VolumesActionsTest-1352839993 None] Detaching volume ba634d55-a144-4c71-8993-729ea0910906 from instance daa3463b-adf4-403c-b71b-4660f3befe0d. Jul 18 06:07:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2341cea5-bdb2-4730-a548-f8f6110e413e tempest-VolumesActionsTest-1352839993 None] Detach volume completed successfully. Jul 18 06:07:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2341cea5-bdb2-4730-a548-f8f6110e413e tempest-VolumesActionsTest-1352839993 None] Lock "cinder-ba634d55-a144-4c71-8993-729ea0910906-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:13 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bc5ea1-dd37-4640-bb5e-cf36fe88bb0e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:13 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 Jul 18 06:07:13 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:13 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906" returned: 0 in 0.476s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:13 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f90f440-ed74-46fd-b846-db4778671b7d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:14 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 Jul 18 06:07:14 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:14 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906" returned: 0 in 0.490s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.34ecf715-2180-425a-99d9-bcc224fdedf7yzwu_ccy.img {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:14 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.34ecf715-2180-425a-99d9-bcc224fdedf7yzwu_ccy.img Jul 18 06:07:14 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=138,cinder:UPDATE=160,cinder:INSERT=39,cinder:DELETE=7 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Flow 'volume_create_manager' (b176ec85-70e3-4201-9f50-893b3ed58f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fdb34b-2085-4028-9472-5ac2b275af4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fdb34b-2085-4028-9472-5ac2b275af4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-335982468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83d4bd9-390c-456d-8e12-785ba75cbdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd9fa070d3a4daab4b46675cee733f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:07:15Z,use_quota=True,user_id='6f60e5aa2aba4170aceee29205fb0b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727403a3-506a-4bf3-90ef-95f9934cc7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (727403a3-506a-4bf3-90ef-95f9934cc7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a5e229-edf0-425b-a401-e547cb550cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a5e229-edf0-425b-a401-e547cb550cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e83d4bd9-390c-456d-8e12-785ba75cbdc6', 'volume_name': 'volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c842ab8b-fec4-4c43-b5bb-8b28361b6571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c842ab8b-fec4-4c43-b5bb-8b28361b6571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7653ba-ec5a-422e-81b0-69610f9798b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:14 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Volume e83d4bd9-390c-456d-8e12-785ba75cbdc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6', 'volume_size': 1} Jul 18 06:07:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:20 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.34ecf715-2180-425a-99d9-bcc224fdedf7yzwu_ccy.img" returned: 0 in 5.861s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:20 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b30a48-ddf9-4ed4-b905-d4d847673eb3]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:20 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 Jul 18 06:07:20 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:20 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906" returned: 0 in 0.662s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:20 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.34ecf715-2180-425a-99d9-bcc224fdedf7yzwu_ccy.img {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:07:20 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] Converted 1024.00 MB image at 174.63 MB/s Jul 18 06:07:20 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] 34ecf715-2180-425a-99d9-bcc224fdedf7 was raw, no need to convert to raw {{(pid=87750) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 18 06:07:27 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:07:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Flow 'volume_create_manager' (2867582b-a014-487c-9427-e7302f6d79ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:07:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6876f4b5-105f-419f-bf1e-76b2874540d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6876f4b5-105f-419f-bf1e-76b2874540d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-356141769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2750ba0d-f36a-4484-b666-df0caeeb00c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efa7c95c9e44ac8226bb8af1a27631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:07:27Z,use_quota=True,user_id='a1a415b047d04c5f8e44b125b8f3781c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ce56f0-bf60-401d-aefc-898afa1c90ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ce56f0-bf60-401d-aefc-898afa1c90ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0284300d-8c92-4f94-952b-268667dfec6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0284300d-8c92-4f94-952b-268667dfec6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2750ba0d-f36a-4484-b666-df0caeeb00c9', 'volume_name': 'volume-2750ba0d-f36a-4484-b666-df0caeeb00c9', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2c0e9b-5c27-493e-bf41-17f4e8319b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2c0e9b-5c27-493e-bf41-17f4e8319b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6343bb1a-0618-4031-82e6-7cf3112ba3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:27 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Volume 2750ba0d-f36a-4484-b666-df0caeeb00c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2750ba0d-f36a-4484-b666-df0caeeb00c9', 'volume_size': 1} Jul 18 06:07:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:07:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:07:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:07:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:35 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:07:35 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:35 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.548s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:07:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:07:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:07:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:07:37 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:DELETE=2,cinder:SELECT=24,cinder:INSERT=6,cinder:UPDATE=21 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:07:37 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:07:39 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:07:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Flow 'volume_create_manager' (12ef2522-895c-41f3-9ecd-3c88c42b38a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:07:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213383e0-fcd3-40b1-9e1d-4427acdab9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213383e0-fcd3-40b1-9e1d-4427acdab9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-528801414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07f1ccd-3081-4321-9adb-884a282f8b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46da04b0b3c64622be12aac44252ef33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:07:39Z,use_quota=True,user_id='c207419fa4fd4f30872d377a6946b1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a841e944-80c6-4537-9bed-c8db03d090cb),volume_type_id=a841e944-80c6-4537-9bed-c8db03d090cb)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3687833-4d00-455f-94e0-3061415cee05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3687833-4d00-455f-94e0-3061415cee05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0147c8-83b4-4e33-847b-300c06c3d35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0147c8-83b4-4e33-847b-300c06c3d35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f07f1ccd-3081-4321-9adb-884a282f8b4e', 'volume_name': 'volume-f07f1ccd-3081-4321-9adb-884a282f8b4e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99ec761-c4a9-44e1-8804-9cab0881762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99ec761-c4a9-44e1-8804-9cab0881762c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e435c8d8-036c-45c0-b4c0-a0dd33b91a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Volume f07f1ccd-3081-4321-9adb-884a282f8b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f07f1ccd-3081-4321-9adb-884a282f8b4e', 'volume_size': 1} Jul 18 06:07:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.839s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] Uploaded volume to glance image-id: 34ecf715-2180-425a-99d9-bcc224fdedf7. {{(pid=87750) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.337s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-335982468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83d4bd9-390c-456d-8e12-785ba75cbdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd9fa070d3a4daab4b46675cee733f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:07:15Z,use_quota=True,user_id='6f60e5aa2aba4170aceee29205fb0b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Creating volume e83d4bd9-390c-456d-8e12-785ba75cbdc6 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:07:47 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:47 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6 1073741824 Jul 18 06:07:47 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-527feaee-886e-4f46-ac00-ec39b582757c tempest-VolumesActionsTest-1352839993 None] Copy volume to image completed successfully. Jul 18 06:07:47 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6 1073741824" returned: 0 in 0.441s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:47 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6 Jul 18 06:07:47 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:47 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.564s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-356141769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2750ba0d-f36a-4484-b666-df0caeeb00c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efa7c95c9e44ac8226bb8af1a27631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:07:27Z,use_quota=True,user_id='a1a415b047d04c5f8e44b125b8f3781c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Creating volume 2750ba0d-f36a-4484-b666-df0caeeb00c9 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:07:47 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:07:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7653ba-ec5a-422e-81b0-69610f9798b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:48 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 1073741824 Jul 18 06:07:48 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18cdfcd-7b0d-4a28-b012-123418defde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:48 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Volume volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6 (e83d4bd9-390c-456d-8e12-785ba75cbdc6): created successfully Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18cdfcd-7b0d-4a28-b012-123418defde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Flow 'volume_create_manager' (b176ec85-70e3-4201-9f50-893b3ed58f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:07:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9c65d904-5436-41fb-a795-1033a518507e tempest-VolumesTransfersV355Test-948479722 None] Created volume successfully. Jul 18 06:07:48 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 1073741824" returned: 0 in 0.524s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:48 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 Jul 18 06:07:48 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:48 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9" returned: 0 in 0.298s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.662s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-528801414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f07f1ccd-3081-4321-9adb-884a282f8b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46da04b0b3c64622be12aac44252ef33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:07:39Z,use_quota=True,user_id='c207419fa4fd4f30872d377a6946b1a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a841e944-80c6-4537-9bed-c8db03d090cb),volume_type_id=a841e944-80c6-4537-9bed-c8db03d090cb)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Creating volume f07f1ccd-3081-4321-9adb-884a282f8b4e {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:07:48 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f07f1ccd-3081-4321-9adb-884a282f8b4e 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6343bb1a-0618-4031-82e6-7cf3112ba3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2750ba0d-f36a-4484-b666-df0caeeb00c9', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae45feb6-14c3-408b-bd8c-b2a8dbf59d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:48 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f07f1ccd-3081-4321-9adb-884a282f8b4e 1073741824 Jul 18 06:07:48 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Volume volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 (2750ba0d-f36a-4484-b666-df0caeeb00c9): created successfully Jul 18 06:07:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae45feb6-14c3-408b-bd8c-b2a8dbf59d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Flow 'volume_create_manager' (2867582b-a014-487c-9427-e7302f6d79ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:07:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b9c1a92b-c3b5-4b62-9267-0c45ad373faf tempest-TestStampPattern-1537119279 None] Created volume successfully. Jul 18 06:07:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:49 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f07f1ccd-3081-4321-9adb-884a282f8b4e 1073741824" returned: 0 in 0.859s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f07f1ccd-3081-4321-9adb-884a282f8b4e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:49 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f07f1ccd-3081-4321-9adb-884a282f8b4e Jul 18 06:07:49 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9d3a20a9-b07b-44ad-870e-910b0d25f49c tempest-VolumesTransfersV355Test-1865190501 None] Transfer volume completed successfully. Jul 18 06:07:50 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f07f1ccd-3081-4321-9adb-884a282f8b4e" returned: 0 in 0.291s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.407s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e435c8d8-036c-45c0-b4c0-a0dd33b91a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f07f1ccd-3081-4321-9adb-884a282f8b4e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e1dff4-79c2-4bd6-a678-6ca7ea5ba2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b99c71-0bde-4644-a955-a221e17d1428]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Volume volume-f07f1ccd-3081-4321-9adb-884a282f8b4e (f07f1ccd-3081-4321-9adb-884a282f8b4e): created successfully Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e1dff4-79c2-4bd6-a678-6ca7ea5ba2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Flow 'volume_create_manager' (12ef2522-895c-41f3-9ecd-3c88c42b38a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:07:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-74a44e75-cc0f-4d4e-a08a-c0bba5ff0c96 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Created volume successfully. Jul 18 06:07:50 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 Jul 18 06:07:50 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Acquiring lock "cinder-e83d4bd9-390c-456d-8e12-785ba75cbdc6-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Lock "cinder-e83d4bd9-390c-456d-8e12-785ba75cbdc6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Acquiring lock "cinder-quobyte-e83d4bd9-390c-456d-8e12-785ba75cbdc6" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Lock "cinder-quobyte-e83d4bd9-390c-456d-8e12-785ba75cbdc6" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[919e23d8-0001-49e3-afab-ea93eed318d0]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:50 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906" returned: 0 in 0.404s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad97d5a-a95f-4728-afca-0b8389f38dcb]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:50 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6 Jul 18 06:07:50 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:50 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 Jul 18 06:07:50 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:50 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6" returned: 0 in 0.382s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:50 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:50 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6 Jul 18 06:07:50 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:50 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img Jul 18 06:07:50 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:51 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e83d4bd9-390c-456d-8e12-785ba75cbdc6" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Lock "cinder-quobyte-e83d4bd9-390c-456d-8e12-785ba75cbdc6" released by "delete_volume" :: held 0.757s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Created reservations ['cb8a3d71-1154-449d-8742-94f94629026e', 'f055c085-a89d-4b92-beb8-fd75c4eacfa8', '413cccb1-6970-4194-bc9e-24f65be3ebb9', '0f43fade-874d-4648-bf8a-8d90f042b004'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-888a5648-5613-44b4-a071-0b9761984291 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-888a5648-5613-44b4-a071-0b9761984291 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-888a5648-5613-44b4-a071-0b9761984291 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-888a5648-5613-44b4-a071-0b9761984291 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-888a5648-5613-44b4-a071-0b9761984291 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-888a5648-5613-44b4-a071-0b9761984291 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:51 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:07:51 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:51 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:07:51 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:52 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-888a5648-5613-44b4-a071-0b9761984291 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.700s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:52 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-888a5648-5613-44b4-a071-0b9761984291 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:07:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-888a5648-5613-44b4-a071-0b9761984291 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Retype volume completed successfully. Jul 18 06:07:52 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.959s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:52 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:07:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Deleted volume successfully. Jul 18 06:07:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-70584abe-4e28-40b1-bf84-bfddca145774 tempest-VolumesTransfersV355Test-2013598098 None] Lock "cinder-e83d4bd9-390c-456d-8e12-785ba75cbdc6-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Acquiring lock "cinder-f07f1ccd-3081-4321-9adb-884a282f8b4e-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Lock "cinder-f07f1ccd-3081-4321-9adb-884a282f8b4e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Flow 'volume_create_manager' (e86b642d-cc1f-4cf5-a59b-142d2feec338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0853622-47c7-4770-a978-c53ff55ddfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0853622-47c7-4770-a978-c53ff55ddfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-214703060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d015a49-0199-443a-a068-49ee9b9044bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd9fa070d3a4daab4b46675cee733f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:07:53Z,use_quota=True,user_id='6f60e5aa2aba4170aceee29205fb0b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9839e8ab-9e34-4743-b8c7-0a53b7df2b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9839e8ab-9e34-4743-b8c7-0a53b7df2b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6bf81f-ffb5-4977-b918-3ab258eef0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6bf81f-ffb5-4977-b918-3ab258eef0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d015a49-0199-443a-a068-49ee9b9044bd', 'volume_name': 'volume-0d015a49-0199-443a-a068-49ee9b9044bd', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1580f7f-5e48-4d53-b66a-52511428b7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1580f7f-5e48-4d53-b66a-52511428b7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8164cb7-dbdb-447d-849e-24ab4fae08f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:07:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Volume 0d015a49-0199-443a-a068-49ee9b9044bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d015a49-0199-443a-a068-49ee9b9044bd', 'volume_size': 1} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Acquiring lock "cinder-quobyte-f07f1ccd-3081-4321-9adb-884a282f8b4e" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Lock "cinder-quobyte-f07f1ccd-3081-4321-9adb-884a282f8b4e" acquired by "delete_volume" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f894d344-f630-4992-96ba-ca2e94464073]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f07f1ccd-3081-4321-9adb-884a282f8b4e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:53 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f07f1ccd-3081-4321-9adb-884a282f8b4e Jul 18 06:07:53 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:54 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f07f1ccd-3081-4321-9adb-884a282f8b4e" returned: 0 in 0.800s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f07f1ccd-3081-4321-9adb-884a282f8b4e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:54 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f07f1ccd-3081-4321-9adb-884a282f8b4e Jul 18 06:07:54 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:54 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f07f1ccd-3081-4321-9adb-884a282f8b4e" returned: 0 in 0.532s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Lock "cinder-quobyte-f07f1ccd-3081-4321-9adb-884a282f8b4e" released by "delete_volume" :: held 1.420s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:55 devstack cinder-volume[87750]: WARNING cinder.quota [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:07:55 devstack cinder-volume[87750]: WARNING cinder.quota [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:07:55 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Created reservations ['071e87f2-5d5d-4cba-a9b4-295e59312ffc', '173d1464-bcca-479b-ac14-0448150682c9', '1ff84ff1-1b53-44ae-82d2-b155e370f3dc', 'e65044d8-01e2-4a88-8a20-a3984769b39e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:07:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:07:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:07:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:07:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:07:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:07:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:55 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:07:55 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:56 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.436s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:07:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Deleted volume successfully. Jul 18 06:07:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d128a622-935f-48fb-b031-4e152d701a05 tempest-VolumeRetypeWithoutMigrationTest-654445038 None] Lock "cinder-f07f1ccd-3081-4321-9adb-884a282f8b4e-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:07:56 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img" returned: 0 in 5.440s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:56 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a644fc67-5b8f-4b01-b3d4-af445b585929]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:56 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 Jul 18 06:07:56 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:56 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906" returned: 0 in 0.610s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:56 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:07:56 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Converted 1024.00 MB image at 188.20 MB/s Jul 18 06:07:56 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] 5112b4f4-37b1-469a-8250-cc33217d1a73 was raw, converting to qcow2 {{(pid=87750) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 18 06:07:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ddcf81-5318-45cc-b22a-20a890b82373]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:57 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img Jul 18 06:07:57 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:57 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img" returned: 0 in 0.412s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:57 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img Jul 18 06:07:57 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:57 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img" returned: 1 in 0.368s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:07:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img /opt/stack/data/cinder/conversion/vol_upload_ct1hbdb3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:57 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img /opt/stack/data/cinder/conversion/vol_upload_ct1hbdb3 Jul 18 06:07:57 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:58 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img /opt/stack/data/cinder/conversion/vol_upload_ct1hbdb3" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:07:58 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Image conversion details: src /opt/stack/data/cinder/conversion/ba634d55-a144-4c71-8993-729ea0910906.temp_image.5112b4f4-37b1-469a-8250-cc33217d1a73ti2nu72w.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ct1hbdb3 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:07:58 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 18 06:07:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf61d63-d83d-4f48-aa6c-d9e28cb4955d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:07:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ct1hbdb3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:07:58 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ct1hbdb3 Jul 18 06:07:58 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:07:58 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 18 06:07:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ct1hbdb3" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.968s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Uploaded volume to glance image-id: 5112b4f4-37b1-469a-8250-cc33217d1a73. {{(pid=87750) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.526s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-214703060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d015a49-0199-443a-a068-49ee9b9044bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd9fa070d3a4daab4b46675cee733f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:07:53Z,use_quota=True,user_id='6f60e5aa2aba4170aceee29205fb0b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Creating volume 0d015a49-0199-443a-a068-49ee9b9044bd {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:08:00 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0d015a49-0199-443a-a068-49ee9b9044bd 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:00 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0d015a49-0199-443a-a068-49ee9b9044bd 1073741824 Jul 18 06:08:00 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-901a44e7-ec46-4ea1-8c06-57f9f373c6f6 tempest-VolumesActionsTest-1352839993 None] Copy volume to image completed successfully. Jul 18 06:08:00 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0d015a49-0199-443a-a068-49ee9b9044bd 1073741824" returned: 0 in 0.487s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0d015a49-0199-443a-a068-49ee9b9044bd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:00 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0d015a49-0199-443a-a068-49ee9b9044bd Jul 18 06:08:00 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:00 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0d015a49-0199-443a-a068-49ee9b9044bd" returned: 0 in 0.266s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8164cb7-dbdb-447d-849e-24ab4fae08f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d015a49-0199-443a-a068-49ee9b9044bd', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fdc10a-edeb-4492-bff8-8beaa422b5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:00 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Volume volume-0d015a49-0199-443a-a068-49ee9b9044bd (0d015a49-0199-443a-a068-49ee9b9044bd): created successfully Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fdc10a-edeb-4492-bff8-8beaa422b5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Flow 'volume_create_manager' (e86b642d-cc1f-4cf5-a59b-142d2feec338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-eb1db797-6bff-4b57-b01f-379bdc2b265f tempest-VolumesTransfersV355Test-948479722 None] Created volume successfully. Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Acquiring lock "cinder-ba634d55-a144-4c71-8993-729ea0910906-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Lock "cinder-ba634d55-a144-4c71-8993-729ea0910906-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Acquiring lock "cinder-quobyte-ba634d55-a144-4c71-8993-729ea0910906" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Lock "cinder-quobyte-ba634d55-a144-4c71-8993-729ea0910906" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a86a53-70e1-40f1-8924-85317b61c716]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:01 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 Jul 18 06:08:01 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:01 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:01 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906 Jul 18 06:08:01 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:01 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ba634d55-a144-4c71-8993-729ea0910906" returned: 0 in 0.275s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Lock "cinder-quobyte-ba634d55-a144-4c71-8993-729ea0910906" released by "delete_volume" :: held 0.688s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Created reservations ['2df8e037-99af-40c3-9fdd-df332319948c', '23419024-25ce-429e-af2c-1df5bf49f61c', 'e7ffe480-6de8-410b-b752-6546c9691ad3', '487dad4f-7777-4c93-af4b-fbabfd9e6d08'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:01 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:08:01 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Acquiring lock "cinder-0d015a49-0199-443a-a068-49ee9b9044bd-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Lock "cinder-0d015a49-0199-443a-a068-49ee9b9044bd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Flow 'volume_create_manager' (f2094010-b585-4543-a79e-c31c822ad778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bb6f1c-743b-45c8-a118-b8a09d55bcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bb6f1c-743b-45c8-a118-b8a09d55bcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1716353264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063b49f0-c1a3-452d-9177-893448666524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff8d8b37aea4304951f42eba75d6832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:02Z,use_quota=True,user_id='2a516ed00b5941a0b79ceb028b9da9fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c21be60-fa2e-42bf-81c7-5895fd0edf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c21be60-fa2e-42bf-81c7-5895fd0edf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633d8120-5294-464a-b3d1-842f0f2e8252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633d8120-5294-464a-b3d1-842f0f2e8252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '063b49f0-c1a3-452d-9177-893448666524', 'volume_name': 'volume-063b49f0-c1a3-452d-9177-893448666524', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852ff8a8-e132-445d-a775-646d7a6a68e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852ff8a8-e132-445d-a775-646d7a6a68e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5f6754-0002-4195-a38d-4dfa506e970f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:02 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Volume 063b49f0-c1a3-452d-9177-893448666524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-063b49f0-c1a3-452d-9177-893448666524', 'volume_size': 1} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1716353264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063b49f0-c1a3-452d-9177-893448666524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff8d8b37aea4304951f42eba75d6832',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:02Z,use_quota=True,user_id='2a516ed00b5941a0b79ceb028b9da9fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Creating volume 063b49f0-c1a3-452d-9177-893448666524 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:08:02 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-063b49f0-c1a3-452d-9177-893448666524 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:02 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-063b49f0-c1a3-452d-9177-893448666524 1073741824 Jul 18 06:08:02 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Acquiring lock "cinder-quobyte-0d015a49-0199-443a-a068-49ee9b9044bd" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Lock "cinder-quobyte-0d015a49-0199-443a-a068-49ee9b9044bd" acquired by "delete_volume" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:02 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:08:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Deleted volume successfully. Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5d9de5-3865-4b62-891b-3d70aeba1f21]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0d015a49-0199-443a-a068-49ee9b9044bd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d427636a-416e-4ce0-9039-b8f64b2b57c8 tempest-VolumesActionsTest-1352839993 None] Lock "cinder-ba634d55-a144-4c71-8993-729ea0910906-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:02 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0d015a49-0199-443a-a068-49ee9b9044bd Jul 18 06:08:02 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:02 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0d015a49-0199-443a-a068-49ee9b9044bd" returned: 0 in 0.475s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0d015a49-0199-443a-a068-49ee9b9044bd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:02 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-063b49f0-c1a3-452d-9177-893448666524 1073741824" returned: 0 in 0.618s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:02 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0d015a49-0199-443a-a068-49ee9b9044bd Jul 18 06:08:02 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-063b49f0-c1a3-452d-9177-893448666524 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:02 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-063b49f0-c1a3-452d-9177-893448666524 Jul 18 06:08:02 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-02f900a9-9100-4833-89f6-11a8dc8fa665 req-11a55883-6162-4d7d-9247-6b94b4988149 tempest-TestStampPattern-1537119279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:03 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:03 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-063b49f0-c1a3-452d-9177-893448666524" returned: 0 in 0.401s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-02f900a9-9100-4833-89f6-11a8dc8fa665 req-11a55883-6162-4d7d-9247-6b94b4988149 tempest-TestStampPattern-1537119279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.106s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0d015a49-0199-443a-a068-49ee9b9044bd" returned: 0 in 0.481s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5f6754-0002-4195-a38d-4dfa506e970f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063b49f0-c1a3-452d-9177-893448666524', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f257203e-50e4-492e-a055-49112f49f184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Lock "cinder-quobyte-0d015a49-0199-443a-a068-49ee9b9044bd" released by "delete_volume" :: held 1.032s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-02f900a9-9100-4833-89f6-11a8dc8fa665 req-11a55883-6162-4d7d-9247-6b94b4988149 tempest-TestStampPattern-1537119279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Volume volume-063b49f0-c1a3-452d-9177-893448666524 (063b49f0-c1a3-452d-9177-893448666524): created successfully Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f257203e-50e4-492e-a055-49112f49f184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Flow 'volume_create_manager' (f2094010-b585-4543-a79e-c31c822ad778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b1c87a13-110e-4dc0-ad87-c2624e46c5e3 tempest-VolumesServicesTestJSON-2019584780 None] Created volume successfully. Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-02f900a9-9100-4833-89f6-11a8dc8fa665 req-11a55883-6162-4d7d-9247-6b94b4988149 tempest-TestStampPattern-1537119279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-2750ba0d-f36a-4484-b666-df0caeeb00c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3438e2e9-5d8c-41df-8386-4d8d72aaad7a', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Created reservations ['ba1c90cf-d24c-49ac-a988-7c69b1ea427a', '3fa5240e-a9c9-4c46-afe8-2a62fb9ec886', 'cd2d2c10-d7bf-478f-a43d-e16b8448bbb5', 'c51c518f-a2a3-4c51-8be2-3f55d4d43a85'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:08:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-02f900a9-9100-4833-89f6-11a8dc8fa665 req-11a55883-6162-4d7d-9247-6b94b4988149 tempest-TestStampPattern-1537119279 None] attachment_update completed successfully. Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:03 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:08:03 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:03 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.295s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:08:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Deleted volume successfully. Jul 18 06:08:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d935b9b4-4eaa-489d-9671-a7d2732dcd61 tempest-VolumesTransfersV355Test-2013598098 None] Lock "cinder-0d015a49-0199-443a-a068-49ee9b9044bd-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Acquiring lock "cinder-063b49f0-c1a3-452d-9177-893448666524-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Lock "cinder-063b49f0-c1a3-452d-9177-893448666524-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Acquiring lock "cinder-quobyte-063b49f0-c1a3-452d-9177-893448666524" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Lock "cinder-quobyte-063b49f0-c1a3-452d-9177-893448666524" acquired by "delete_volume" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[07172d2a-d0bb-4493-b080-14b5084e7621]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-063b49f0-c1a3-452d-9177-893448666524 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:04 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-063b49f0-c1a3-452d-9177-893448666524 Jul 18 06:08:04 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:04 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-063b49f0-c1a3-452d-9177-893448666524" returned: 0 in 0.406s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-063b49f0-c1a3-452d-9177-893448666524 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:04 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-063b49f0-c1a3-452d-9177-893448666524 Jul 18 06:08:04 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:05 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-063b49f0-c1a3-452d-9177-893448666524" returned: 0 in 0.293s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Lock "cinder-quobyte-063b49f0-c1a3-452d-9177-893448666524" released by "delete_volume" :: held 0.757s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:05 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Created reservations ['415a84ab-3f57-4e77-949f-8af8944e4bf6', '6cfe9d08-58b9-4aa9-ac7e-ddb3cf7958c7', 'b1713c82-5dc2-4b34-b1ca-ac9bea22d953', 'c822f5fb-c434-4519-8ea1-15106ef85d74'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:08:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:05 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:08:05 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:05 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.356s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:05 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:08:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Deleted volume successfully. Jul 18 06:08:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fbee7f79-544c-42d3-badf-11edd4690cf1 tempest-VolumesServicesTestJSON-2019584780 None] Lock "cinder-063b49f0-c1a3-452d-9177-893448666524-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-fe7f8514-d135-4826-a510-17d70a4cd6d9 req-8dede967-acb0-4d8e-858e-4c1ddef8bfa6 tempest-TestStampPattern-1537119279 None] Terminate volume connection completed successfully. Jul 18 06:08:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-fe7f8514-d135-4826-a510-17d70a4cd6d9 req-8dede967-acb0-4d8e-858e-4c1ddef8bfa6 tempest-TestStampPattern-1537119279 None] Deleting attachment 3438e2e9-5d8c-41df-8386-4d8d72aaad7a. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Flow 'volume_create_manager' (606ed52c-aef2-4b81-8b6c-310df28ce442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5276b168-43c5-476c-b848-fa7cd444e221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5276b168-43c5-476c-b848-fa7cd444e221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1028128339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394a6e77-728e-4c90-9107-2a5265249ba0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fedee741ad44a492ffe0b68d0072fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:10Z,use_quota=True,user_id='97fc0414ce5d4503aba99cec5f6c72a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b836d3-1682-429e-a6a1-ceebc58d11d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22b836d3-1682-429e-a6a1-ceebc58d11d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a903985-24f7-4766-b0ec-99483eceb464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a903985-24f7-4766-b0ec-99483eceb464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394a6e77-728e-4c90-9107-2a5265249ba0', 'volume_name': 'volume-394a6e77-728e-4c90-9107-2a5265249ba0', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631aecc6-2c38-45d0-88e1-df6b6e39ab8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631aecc6-2c38-45d0-88e1-df6b6e39ab8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905f34bb-7ba9-4d75-9427-5fd28e06e057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:10 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Volume 394a6e77-728e-4c90-9107-2a5265249ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394a6e77-728e-4c90-9107-2a5265249ba0', 'volume_size': 1} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1028128339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394a6e77-728e-4c90-9107-2a5265249ba0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fedee741ad44a492ffe0b68d0072fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:10Z,use_quota=True,user_id='97fc0414ce5d4503aba99cec5f6c72a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Creating volume 394a6e77-728e-4c90-9107-2a5265249ba0 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:08:10 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-394a6e77-728e-4c90-9107-2a5265249ba0 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:10 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-394a6e77-728e-4c90-9107-2a5265249ba0 1073741824 Jul 18 06:08:10 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:10 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-394a6e77-728e-4c90-9107-2a5265249ba0 1073741824" returned: 0 in 0.538s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-394a6e77-728e-4c90-9107-2a5265249ba0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:10 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-394a6e77-728e-4c90-9107-2a5265249ba0 Jul 18 06:08:10 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:11 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-394a6e77-728e-4c90-9107-2a5265249ba0" returned: 0 in 0.271s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.594s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] Creating offline snapshot 7e38247f-8bb2-4d3e-8f8f-e937c8062e23 of volume 2750ba0d-f36a-4484-b666-df0caeeb00c9 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905f34bb-7ba9-4d75-9427-5fd28e06e057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394a6e77-728e-4c90-9107-2a5265249ba0', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86970acc-927e-4a81-99a0-18f043aaaaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9bf95d-91a3-4533-9276-6b9ef0b28328]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:11 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Volume volume-394a6e77-728e-4c90-9107-2a5265249ba0 (394a6e77-728e-4c90-9107-2a5265249ba0): created successfully Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86970acc-927e-4a81-99a0-18f043aaaaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Flow 'volume_create_manager' (606ed52c-aef2-4b81-8b6c-310df28ce442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-74164a69-9b61-4a92-abdd-6e51f2279845 tempest-VolumesListTestJSON-432966105 None] Created volume successfully. Jul 18 06:08:11 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 Jul 18 06:08:11 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:11 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9" returned: 0 in 0.409s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:11 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 1G Jul 18 06:08:11 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:11 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 1G" returned: 0 in 0.441s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:11 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 Jul 18 06:08:11 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Flow 'volume_create_manager' (08c61b92-a504-42e4-a2ad-a1beb563d419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fce704-7057-4a7c-b6f7-cb689c36bd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87fce704-7057-4a7c-b6f7-cb689c36bd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-165170628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2dac893-4379-49f9-ace6-ff9a3f339ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e420ba94ad03409b95e2cb89ab608db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:12Z,use_quota=True,user_id='a8796229724045b58100bb84cb70486b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa772f6-a76c-4821-a3ab-2da0ecdc530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa772f6-a76c-4821-a3ab-2da0ecdc530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106772a6-fe66-479d-86cc-90161edd2a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106772a6-fe66-479d-86cc-90161edd2a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2dac893-4379-49f9-ace6-ff9a3f339ee4', 'volume_name': 'volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4', 'volume_size': 2}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7817fe29-91d0-44d2-abc0-ae1e96babe0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7817fe29-91d0-44d2-abc0-ae1e96babe0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550f1970-154e-4461-a24e-f3090fcc99f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Volume f2dac893-4379-49f9-ace6-ff9a3f339ee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4', 'volume_size': 2} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:12 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23" returned: 0 in 0.353s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:12 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 is being set with open permissions: ugo+rw Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:12 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 Jul 18 06:08:12 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:12 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:12 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.info Jul 18 06:08:12 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Flow 'volume_create_manager' (b4ecdf3d-5ccc-4b66-a8ec-f68671dacd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4606f058-96c8-4433-9f0b-e84311b15c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4606f058-96c8-4433-9f0b-e84311b15c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-277017908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd8b7df-ea3c-49ab-84db-9227a6dd98e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fedee741ad44a492ffe0b68d0072fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:13Z,use_quota=True,user_id='97fc0414ce5d4503aba99cec5f6c72a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19803a3d-fa57-4739-a7d6-0769c24452d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19803a3d-fa57-4739-a7d6-0769c24452d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d1b00e-c6ae-4e1c-826f-a932d7d4034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d1b00e-c6ae-4e1c-826f-a932d7d4034f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cd8b7df-ea3c-49ab-84db-9227a6dd98e5', 'volume_name': 'volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21d53fc-8f40-40d8-8637-ef9d9342c6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21d53fc-8f40-40d8-8637-ef9d9342c6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a368150-7744-421a-b8e5-1eae65d5b839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Volume 8cd8b7df-ea3c-49ab-84db-9227a6dd98e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5', 'volume_size': 1} Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:12 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.info" returned: 0 in 0.281s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:12 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.info is being set with open permissions: ugo+rw Jul 18 06:08:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:12 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.info Jul 18 06:08:12 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:13 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.info" returned: 0 in 0.257s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-165170628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2dac893-4379-49f9-ace6-ff9a3f339ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e420ba94ad03409b95e2cb89ab608db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:12Z,use_quota=True,user_id='a8796229724045b58100bb84cb70486b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Creating volume f2dac893-4379-49f9-ace6-ff9a3f339ee4 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:08:13 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4 2147483648 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:13 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4 2147483648 Jul 18 06:08:13 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b50dd5a8-1b99-406c-bcc8-027218b0f2c4 tempest-TestStampPattern-1537119279 None] Create snapshot completed successfully Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Flow 'volume_create_manager' (0f26efc5-a5fe-4050-aa40-0538a43b62f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4b8c6c-5a9b-4f7e-a463-73819e9cf6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4b8c6c-5a9b-4f7e-a463-73819e9cf6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-482290966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08865308-9109-409a-86a6-5241bd2da717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656d041613de4e9390184ed247905f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:13Z,use_quota=True,user_id='2d7471ceee6344e9b529225503fb78a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2367e4f1-3a41-40a6-8b6e-6e5b4eeb3368),volume_type_id=2367e4f1-3a41-40a6-8b6e-6e5b4eeb3368)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4995b880-2112-4522-80df-5df682d2f76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4995b880-2112-4522-80df-5df682d2f76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79279c03-5300-4f1a-b278-ca98cd1f5a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79279c03-5300-4f1a-b278-ca98cd1f5a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08865308-9109-409a-86a6-5241bd2da717', 'volume_name': 'volume-08865308-9109-409a-86a6-5241bd2da717', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70420dbd-5461-4d83-b082-e766ff67022d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70420dbd-5461-4d83-b082-e766ff67022d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fcd0af-4b54-4a48-b02f-7e4d1eb965ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:13 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Volume 08865308-9109-409a-86a6-5241bd2da717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08865308-9109-409a-86a6-5241bd2da717', 'volume_size': 1} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:13 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4 2147483648" returned: 0 in 0.501s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:13 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4 Jul 18 06:08:13 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:14 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4" returned: 0 in 0.244s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-277017908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd8b7df-ea3c-49ab-84db-9227a6dd98e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fedee741ad44a492ffe0b68d0072fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:13Z,use_quota=True,user_id='97fc0414ce5d4503aba99cec5f6c72a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Creating volume 8cd8b7df-ea3c-49ab-84db-9227a6dd98e5 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:08:14 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550f1970-154e-4461-a24e-f3090fcc99f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4', 'volume_size': 2}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:14 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5 1073741824 Jul 18 06:08:14 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823d9736-6956-47c6-b84c-26dee768d296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:14 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Volume volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4 (f2dac893-4379-49f9-ace6-ff9a3f339ee4): created successfully Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823d9736-6956-47c6-b84c-26dee768d296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Flow 'volume_create_manager' (08c61b92-a504-42e4-a2ad-a1beb563d419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-62492346-9459-40ad-9273-b429c18c07de tempest-VolumesCloneNegativeTest-1030357960 None] Created volume successfully. Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Acquiring lock "cinder-f2dac893-4379-49f9-ace6-ff9a3f339ee4-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Lock "cinder-f2dac893-4379-49f9-ace6-ff9a3f339ee4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Acquiring lock "cinder-quobyte-f2dac893-4379-49f9-ace6-ff9a3f339ee4" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Lock "cinder-quobyte-f2dac893-4379-49f9-ace6-ff9a3f339ee4" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99422b0-28d4-4134-9f64-79222a8b57eb]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:14 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5 1073741824" returned: 0 in 0.537s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:14 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5 Jul 18 06:08:14 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:14 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4 Jul 18 06:08:14 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:14 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-482290966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08865308-9109-409a-86a6-5241bd2da717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656d041613de4e9390184ed247905f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:13Z,use_quota=True,user_id='2d7471ceee6344e9b529225503fb78a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2367e4f1-3a41-40a6-8b6e-6e5b4eeb3368),volume_type_id=2367e4f1-3a41-40a6-8b6e-6e5b4eeb3368)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Creating volume 08865308-9109-409a-86a6-5241bd2da717 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:08:14 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08865308-9109-409a-86a6-5241bd2da717 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a368150-7744-421a-b8e5-1eae65d5b839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:14 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08865308-9109-409a-86a6-5241bd2da717 1073741824 Jul 18 06:08:14 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488b9451-a8ee-44ca-8b1b-92b21bd25915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:14 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Volume volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5 (8cd8b7df-ea3c-49ab-84db-9227a6dd98e5): created successfully Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488b9451-a8ee-44ca-8b1b-92b21bd25915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Flow 'volume_create_manager' (b4ecdf3d-5ccc-4b66-a8ec-f68671dacd8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:14 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4" returned: 0 in 0.450s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-bce4f720-aad4-44ab-85f0-90f78b961c3f tempest-VolumesListTestJSON-432966105 None] Created volume successfully. Jul 18 06:08:15 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4 Jul 18 06:08:15 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:15 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f2dac893-4379-49f9-ace6-ff9a3f339ee4" returned: 0 in 0.333s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Lock "cinder-quobyte-f2dac893-4379-49f9-ace6-ff9a3f339ee4" released by "delete_volume" :: held 0.842s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Created reservations ['9e56fa7c-1140-4ce7-bbd7-d90dc84e68b3', '4afe98ad-6e22-4684-991b-5a96d627cccd', '4850b304-4520-4b0f-b59c-659ad9b28bfa', '2b82d97c-d848-4844-95ae-b915166b9873'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:08:15 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08865308-9109-409a-86a6-5241bd2da717 1073741824" returned: 0 in 0.503s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08865308-9109-409a-86a6-5241bd2da717 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:15 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08865308-9109-409a-86a6-5241bd2da717 Jul 18 06:08:15 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:15 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:08:15 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:15 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08865308-9109-409a-86a6-5241bd2da717" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fcd0af-4b54-4a48-b02f-7e4d1eb965ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08865308-9109-409a-86a6-5241bd2da717', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc5eabf-4851-46e0-9024-a2b800578e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:15 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Volume volume-08865308-9109-409a-86a6-5241bd2da717 (08865308-9109-409a-86a6-5241bd2da717): created successfully Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc5eabf-4851-46e0-9024-a2b800578e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:15 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Flow 'volume_create_manager' (0f26efc5-a5fe-4050-aa40-0538a43b62f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.314s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:08:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Deleted volume successfully. Jul 18 06:08:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ff8b24a6-46e1-48b7-a3c0-0babcf36e297 tempest-VolumeTypesAccessTest-1844974961 None] Created volume successfully. Jul 18 06:08:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c6101e89-e35d-4ec1-8f03-55c83854cb0f tempest-VolumesCloneNegativeTest-1030357960 None] Lock "cinder-f2dac893-4379-49f9-ace6-ff9a3f339ee4-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Flow 'volume_create_manager' (ecc3950f-d1e3-43e1-a733-eb3a39817b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3edab46-4001-48e2-b1f1-69e130ff6f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3edab46-4001-48e2-b1f1-69e130ff6f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1111512817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36b525b-b396-48d3-9264-7970d3f6358c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fedee741ad44a492ffe0b68d0072fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:16Z,use_quota=True,user_id='97fc0414ce5d4503aba99cec5f6c72a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c992003-cadd-4236-8a2f-e56eb564e926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c992003-cadd-4236-8a2f-e56eb564e926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36684133-af14-476b-a70b-9a980a642f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36684133-af14-476b-a70b-9a980a642f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36b525b-b396-48d3-9264-7970d3f6358c', 'volume_name': 'volume-d36b525b-b396-48d3-9264-7970d3f6358c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9bf25d8-7b87-4d91-936a-a7dbe82f05ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9bf25d8-7b87-4d91-936a-a7dbe82f05ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ca9f52-99b8-4796-99c2-bd9e99e2430e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Volume d36b525b-b396-48d3-9264-7970d3f6358c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36b525b-b396-48d3-9264-7970d3f6358c', 'volume_size': 1} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1111512817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36b525b-b396-48d3-9264-7970d3f6358c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fedee741ad44a492ffe0b68d0072fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:16Z,use_quota=True,user_id='97fc0414ce5d4503aba99cec5f6c72a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Creating volume d36b525b-b396-48d3-9264-7970d3f6358c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:08:16 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d36b525b-b396-48d3-9264-7970d3f6358c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Acquiring lock "cinder-08865308-9109-409a-86a6-5241bd2da717-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:16 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d36b525b-b396-48d3-9264-7970d3f6358c 1073741824 Jul 18 06:08:16 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Lock "cinder-08865308-9109-409a-86a6-5241bd2da717-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Acquiring lock "cinder-quobyte-08865308-9109-409a-86a6-5241bd2da717" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Lock "cinder-quobyte-08865308-9109-409a-86a6-5241bd2da717" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[139cc243-89a6-4c9e-baef-f550247724d6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08865308-9109-409a-86a6-5241bd2da717 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:16 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08865308-9109-409a-86a6-5241bd2da717 Jul 18 06:08:16 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:17 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d36b525b-b396-48d3-9264-7970d3f6358c 1073741824" returned: 0 in 0.586s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d36b525b-b396-48d3-9264-7970d3f6358c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:17 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08865308-9109-409a-86a6-5241bd2da717" returned: 0 in 0.476s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08865308-9109-409a-86a6-5241bd2da717 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:17 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d36b525b-b396-48d3-9264-7970d3f6358c Jul 18 06:08:17 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:17 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08865308-9109-409a-86a6-5241bd2da717 Jul 18 06:08:17 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:17 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d36b525b-b396-48d3-9264-7970d3f6358c" returned: 0 in 0.327s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ca9f52-99b8-4796-99c2-bd9e99e2430e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36b525b-b396-48d3-9264-7970d3f6358c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc418e4-5029-4891-9ce1-27b32694ece8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:17 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Volume volume-d36b525b-b396-48d3-9264-7970d3f6358c (d36b525b-b396-48d3-9264-7970d3f6358c): created successfully Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc418e4-5029-4891-9ce1-27b32694ece8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:17 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Flow 'volume_create_manager' (ecc3950f-d1e3-43e1-a733-eb3a39817b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08865308-9109-409a-86a6-5241bd2da717" returned: 0 in 0.355s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Lock "cinder-quobyte-08865308-9109-409a-86a6-5241bd2da717" released by "delete_volume" :: held 0.890s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-354bf827-c4e5-4b46-abbd-98b067ae9f4a tempest-VolumesListTestJSON-432966105 None] Created volume successfully. Jul 18 06:08:17 devstack cinder-volume[87750]: WARNING cinder.quota [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-625688517 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-625688517, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:08:17 devstack cinder-volume[87750]: WARNING cinder.quota [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-625688517 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-625688517, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Created reservations ['3641ed20-633d-4e8e-ac2f-183a363f122f', '77a9e5e0-6e9f-4940-b99c-92dff22b5c46', '07ed9b5c-ed20-479a-a2a4-4f7c8f88e493', 'c061aa88-e286-4db1-8ee6-e75fc16c9517'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:17 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:08:17 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:18 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:18 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:08:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Deleted volume successfully. Jul 18 06:08:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8957fd34-387e-4678-93ab-b1732e3d83b5 tempest-VolumeTypesAccessTest-1844974961 None] Lock "cinder-08865308-9109-409a-86a6-5241bd2da717-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Flow 'volume_create_manager' (a48fa580-29ff-4ee8-a1f1-a4d7098b23e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6307eb8-8074-4760-9f54-cb4e3ddce3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6307eb8-8074-4760-9f54-cb4e3ddce3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2073184676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9104c2b5-bfc5-45a9-bf63-409fc8f09dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec49209ab1604cec8746cb4f1dd08d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:19Z,use_quota=True,user_id='62deebfb65024a37939690041693f880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e02a9d2-41e8-4b5b-bba4-78478567fb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e02a9d2-41e8-4b5b-bba4-78478567fb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fce9a56-62ba-4231-8067-60a19742e1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fce9a56-62ba-4231-8067-60a19742e1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9104c2b5-bfc5-45a9-bf63-409fc8f09dc6', 'volume_name': 'volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6', 'volume_size': 2}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991a44be-8b14-462b-b694-319e6297b810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991a44be-8b14-462b-b694-319e6297b810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ad0eb4-e0ff-4574-925a-238655ea6595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:19 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Volume 9104c2b5-bfc5-45a9-bf63-409fc8f09dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6', 'volume_size': 2} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2073184676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9104c2b5-bfc5-45a9-bf63-409fc8f09dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec49209ab1604cec8746cb4f1dd08d39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:19Z,use_quota=True,user_id='62deebfb65024a37939690041693f880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Creating volume 9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:08:19 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:08:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 2147483648 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:19 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 2147483648 Jul 18 06:08:19 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:20 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 2147483648" returned: 0 in 0.749s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:20 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 Jul 18 06:08:20 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:20 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6" returned: 0 in 0.348s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:08:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ad0eb4-e0ff-4574-925a-238655ea6595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6', 'volume_size': 2}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bc3f91-799e-4fea-8a03-d25de71021c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Volume volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 (9104c2b5-bfc5-45a9-bf63-409fc8f09dc6): created successfully Jul 18 06:08:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bc3f91-799e-4fea-8a03-d25de71021c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Flow 'volume_create_manager' (a48fa580-29ff-4ee8-a1f1-a4d7098b23e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:20 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b83cd1d2-fa6d-4e60-8669-ed0325ef9269 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Created volume successfully. Jul 18 06:08:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Acquiring lock "cinder-d36b525b-b396-48d3-9264-7970d3f6358c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Lock "cinder-d36b525b-b396-48d3-9264-7970d3f6358c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Acquiring lock "cinder-quobyte-d36b525b-b396-48d3-9264-7970d3f6358c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Lock "cinder-quobyte-d36b525b-b396-48d3-9264-7970d3f6358c" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[971a3a40-1002-457b-ad64-0281e6744a19]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d36b525b-b396-48d3-9264-7970d3f6358c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:21 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Creating offline snapshot f0243dfa-1d03-484d-8433-7bdad6180859 of volume 9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:08:22 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d36b525b-b396-48d3-9264-7970d3f6358c Jul 18 06:08:22 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd2ba8f-2368-44f7-983e-33452c28a1b4]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Flow 'volume_create_manager' (0573dd8e-d4e3-4f05-9b2e-cd091c39d2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c5bbb0-8da3-4002-bbe0-db116412b897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c5bbb0-8da3-4002-bbe0-db116412b897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1131349203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=118a9aad-e584-41d8-bf82-d8213bcf57e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59efa7c95c9e44ac8226bb8af1a27631',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e38247f-8bb2-4d3e-8f8f-e937c8062e23,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:22Z,use_quota=True,user_id='a1a415b047d04c5f8e44b125b8f3781c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41c4d1f-521d-4033-bb7f-c6f2c0918672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41c4d1f-521d-4033-bb7f-c6f2c0918672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebe46c7-c824-4fe0-8520-3b7b09f5a3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebe46c7-c824-4fe0-8520-3b7b09f5a3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '118a9aad-e584-41d8-bf82-d8213bcf57e5', 'volume_name': 'volume-118a9aad-e584-41d8-bf82-d8213bcf57e5', 'volume_size': 1, 'snapshot_id': '7e38247f-8bb2-4d3e-8f8f-e937c8062e23'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e4c70f-9bf8-405b-b948-e377776bd6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e4c70f-9bf8-405b-b948-e377776bd6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1898c2-79ab-470f-b5e9-9a5c373a5f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:22 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Volume 118a9aad-e584-41d8-bf82-d8213bcf57e5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-118a9aad-e584-41d8-bf82-d8213bcf57e5', 'volume_size': 1, 'snapshot_id': '7e38247f-8bb2-4d3e-8f8f-e937c8062e23'} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:22 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 Jul 18 06:08:22 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:22 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d36b525b-b396-48d3-9264-7970d3f6358c" returned: 0 in 0.541s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d36b525b-b396-48d3-9264-7970d3f6358c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:22 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d36b525b-b396-48d3-9264-7970d3f6358c Jul 18 06:08:22 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:22 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6" returned: 0 in 0.496s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 2G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:22 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 2G Jul 18 06:08:22 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:22 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d36b525b-b396-48d3-9264-7970d3f6358c" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Lock "cinder-quobyte-d36b525b-b396-48d3-9264-7970d3f6358c" released by "delete_volume" :: held 0.923s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Created reservations ['c6a1d7bf-1f3f-4f6f-8359-0583beb2966d', '2effc817-3533-4dde-aa58-748ede54f533', '806ba807-edc6-4e7d-b702-0a9dc6275027', '0278db04-9dc5-40be-b7d9-2dc1a1237f82'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:23 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:08:23 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Acquiring lock "cinder-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Lock "cinder-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:23 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Acquiring lock "cinder-quobyte-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 2G" returned: 0 in 0.709s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Lock "cinder-quobyte-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5" acquired by "delete_volume" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:23 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 Jul 18 06:08:23 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e11d3b7-d28a-46e3-808a-8f9a7bb7b2a6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:23 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.427s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:08:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Deleted volume successfully. Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-40ff90fe-f400-4925-a4e3-200b1c775711 tempest-VolumesListTestJSON-432966105 None] Lock "cinder-d36b525b-b396-48d3-9264-7970d3f6358c-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:23 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5 Jul 18 06:08:23 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:23 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859" returned: 0 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:23 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 is being set with open permissions: ugo+rw Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:23 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 Jul 18 06:08:23 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:23 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5" returned: 0 in 0.516s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:23 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5 Jul 18 06:08:23 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:23 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859" returned: 0 in 0.323s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:24 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.info Jul 18 06:08:24 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:24 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5" returned: 0 in 0.298s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Lock "cinder-quobyte-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5" released by "delete_volume" :: held 0.868s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Created reservations ['4c68eac0-a56b-4f11-a201-9b93d15e81ca', '8460d29d-c9d4-4f48-b1da-0a070437d7d5', '7fe8ad47-2b89-431a-9993-20d3aaaffc1b', '6f1c176f-1c53-4c92-90a2-41cd90848ce0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:24 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.info" returned: 0 in 0.369s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:24 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.info is being set with open permissions: ugo+rw Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:24 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:08:24 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:24 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.info Jul 18 06:08:24 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:24 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:08:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Deleted volume successfully. Jul 18 06:08:24 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.info" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.775s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.553s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Acquiring lock "cinder-quobyte-7e38247f-8bb2-4d3e-8f8f-e937c8062e23-118a9aad-e584-41d8-bf82-d8213bcf57e5" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-759672b2-9be6-45b8-b989-64eef4fd61e0 tempest-VolumesListTestJSON-432966105 None] Lock "cinder-8cd8b7df-ea3c-49ab-84db-9227a6dd98e5-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-13094a1e-778f-4ea2-8d77-03ae05fe8bb2 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Create snapshot completed successfully Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Lock "cinder-quobyte-7e38247f-8bb2-4d3e-8f8f-e937c8062e23-118a9aad-e584-41d8-bf82-d8213bcf57e5" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Creating volume 118a9aad-e584-41d8-bf82-d8213bcf57e5 from snapshot 7e38247f-8bb2-4d3e-8f8f-e937c8062e23 {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Acquiring lock "cinder-quobyte-118a9aad-e584-41d8-bf82-d8213bcf57e5" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Lock "cinder-quobyte-118a9aad-e584-41d8-bf82-d8213bcf57e5" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] snapshot: 7e38247f-8bb2-4d3e-8f8f-e937c8062e23, volume: 118a9aad-e584-41d8-bf82-d8213bcf57e5, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0375b02-e2d6-4cf8-b1a3-7c71c29bc666]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:25 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 Jul 18 06:08:25 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23" returned: 0 in 0.505s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:25 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2750ba0d-f36a-4484-b666-df0caeeb00c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:08:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 06:08:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 06:08:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d818e52-2582-4030-bc86-fdecff0f2f01]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Acquiring lock "cinder-394a6e77-728e-4c90-9107-2a5265249ba0-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Lock "cinder-394a6e77-728e-4c90-9107-2a5265249ba0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:25 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 Jul 18 06:08:25 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Acquiring lock "cinder-quobyte-394a6e77-728e-4c90-9107-2a5265249ba0" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Lock "cinder-quobyte-394a6e77-728e-4c90-9107-2a5265249ba0" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[870f866e-8c98-420e-a3ac-167dbd2e7a1b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-394a6e77-728e-4c90-9107-2a5265249ba0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:26 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9" returned: 0 in 0.743s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Path /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:26 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-394a6e77-728e-4c90-9107-2a5265249ba0 Jul 18 06:08:26 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:26 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 Jul 18 06:08:26 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Acquiring lock "cinder-f0243dfa-1d03-484d-8433-7bdad6180859-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "cinder-f0243dfa-1d03-484d-8433-7bdad6180859-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Acquiring lock "cinder-quobyte-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "cinder-quobyte-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Acquiring lock "cinder-quobyte-f0243dfa-1d03-484d-8433-7bdad6180859" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "cinder-quobyte-f0243dfa-1d03-484d-8433-7bdad6180859" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Deleting offline snapshot f0243dfa-1d03-484d-8433-7bdad6180859 of volume 9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] snapshot_file for this snap is: volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7fd219-6ced-4d6a-9e8c-5d4b1add05db]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:26 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-394a6e77-728e-4c90-9107-2a5265249ba0" returned: 0 in 0.754s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-394a6e77-728e-4c90-9107-2a5265249ba0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:26 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-394a6e77-728e-4c90-9107-2a5265249ba0 Jul 18 06:08:26 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:26 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 Jul 18 06:08:26 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:27 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-394a6e77-728e-4c90-9107-2a5265249ba0" returned: 0 in 0.623s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Lock "cinder-quobyte-394a6e77-728e-4c90-9107-2a5265249ba0" released by "delete_volume" :: held 1.484s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Created reservations ['bfedd707-14fc-4f36-886c-926fcd91aaac', '1e88b537-f47d-4dd2-9ef5-7bf70a3a7147', '63272f1e-7a82-4bbf-b4a0-305eeb28aa2c', '0b16e948-66ae-4c5c-9ae4-d22b8ba2a044'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:08:27 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859" returned: 0 in 0.971s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d2393b-f1e2-4746-972c-c221453e917d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:27 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:08:27 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:28 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 Jul 18 06:08:28 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:28 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6" returned: 0 in 1.058s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:28 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 Jul 18 06:08:28 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:28 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 1.075s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:28 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:08:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Deleted volume successfully. Jul 18 06:08:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5ca76968-2194-4ba2-ad78-58fa4276fcbf tempest-VolumesListTestJSON-432966105 None] Lock "cinder-394a6e77-728e-4c90-9107-2a5265249ba0-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:29 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859" returned: 0 in 1.043s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:29 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859 Jul 18 06:08:29 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:30 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6.f0243dfa-1d03-484d-8433-7bdad6180859" returned: 0 in 0.930s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "cinder-quobyte-f0243dfa-1d03-484d-8433-7bdad6180859" released by "_delete_snapshot" :: held 4.323s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "cinder-quobyte-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6" released by "delete_snapshot" :: held 4.371s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:30 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Created reservations ['7573465a-6d24-4ae5-8652-a58ee6a10e38', 'c92a2654-18c5-4f2f-9744-8a15375a52cc', '75384f13-a289-40e0-9417-87eb73c8364d', 'a44f750d-af20-4a29-86fe-d325e1ac58af'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:08:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Delete snapshot completed successfully. Jul 18 06:08:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d775bc66-ba2d-4d8c-b569-fe82c6a79529 tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "cinder-f0243dfa-1d03-484d-8433-7bdad6180859-delete_snapshot" released by "delete_snapshot" :: held 4.787s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Acquiring lock "cinder-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "cinder-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Acquiring lock "cinder-quobyte-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:08:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "cinder-quobyte-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6" acquired by "delete_volume" :: waited 0.053s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:08:32 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09186fc-5bc5-4597-82a5-b4101faa1118]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:33 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 Jul 18 06:08:33 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:33 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6" returned: 0 in 1.179s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:34 devstack sudo[99849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6 Jul 18 06:08:34 devstack sudo[99849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:34 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5" returned: 0 in 8.272s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:34 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8a1eaf-58a9-4747-8fc9-a183aba60a58]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:34 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 Jul 18 06:08:34 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:34 devstack sudo[99849]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6" returned: 0 in 0.806s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "cinder-quobyte-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6" released by "delete_volume" :: held 2.181s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:34 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Created reservations ['56f97e92-71b8-43b1-9c07-41b728758044', 'f3d812ca-7cc7-44e3-8eb3-43072ed05e5d', '5e052257-d5a0-430e-af76-10e8cbb06352', '3263f073-c3f9-4b09-b3b9-7b8a753b51be'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:35 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:08:35 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:35 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:08:35 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:35 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.520s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:08:35 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.754s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:08:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Deleted volume successfully. Jul 18 06:08:35 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9" returned: 0 in 1.423s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9, size 1024.00 MB, duration 8.27 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:08:35 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Converted 1024.00 MB image at 123.75 MB/s Jul 18 06:08:35 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 is being set with open permissions: ugo+rw Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3d961117-2959-4cd6-a3e7-543cd75e60bf tempest-VolumesSnapshotNegativeTestJSON-567850765 None] Lock "cinder-9104c2b5-bfc5-45a9-bf63-409fc8f09dc6-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:35 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 Jul 18 06:08:35 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:36 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5" returned: 0 in 0.376s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Lock "cinder-quobyte-118a9aad-e584-41d8-bf82-d8213bcf57e5" released by "_copy_volume_from_snapshot" :: held 11.462s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Lock "cinder-quobyte-7e38247f-8bb2-4d3e-8f8f-e937c8062e23-118a9aad-e584-41d8-bf82-d8213bcf57e5" released by "_create_volume_from_snapshot" :: held 11.510s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:08:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.560s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1898c2-79ab-470f-b5e9-9a5c373a5f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118a9aad-e584-41d8-bf82-d8213bcf57e5', 'volume_size': 1, 'snapshot_id': '7e38247f-8bb2-4d3e-8f8f-e937c8062e23'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc89d332-73ac-43d4-866d-49c256c996c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:36 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Volume volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 (118a9aad-e584-41d8-bf82-d8213bcf57e5): created successfully Jul 18 06:08:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc89d332-73ac-43d4-866d-49c256c996c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Flow 'volume_create_manager' (0573dd8e-d4e3-4f05-9b2e-cd091c39d2c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e1fcbf62-234c-4445-9ecd-f9ad4c24d3c9 tempest-TestStampPattern-1537119279 None] Created volume successfully. Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=138,cinder:SELECT=96,cinder:INSERT=29,cinder:DELETE=18 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=120,cinder:UPDATE=138,cinder:INSERT=32,cinder:DELETE=7 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Flow 'volume_create_manager' (2680d06f-0791-4bd8-b343-8a3e7cb6ab4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdd9670-e9f4-42cd-9ce8-60a5c522110a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdd9670-e9f4-42cd-9ce8-60a5c522110a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1637174690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a52bac9-24f5-4d89-a4c3-d64428c42711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f039c9145094c6ca3be2d23eccf6860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:38Z,use_quota=True,user_id='6cc7c23cf7dd41f0b02ed9e0effa1c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70387d83-2c5e-4cb0-9ce1-73c304d32612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70387d83-2c5e-4cb0-9ce1-73c304d32612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6446b052-5954-48d3-83ca-8fd3d082d995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6446b052-5954-48d3-83ca-8fd3d082d995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a52bac9-24f5-4d89-a4c3-d64428c42711', 'volume_name': 'volume-2a52bac9-24f5-4d89-a4c3-d64428c42711', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086cd91f-a31d-4069-8cd4-84d3ae4d9962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086cd91f-a31d-4069-8cd4-84d3ae4d9962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb12c532-c1bf-4603-8be8-3ffc4f9fd161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:38 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Volume 2a52bac9-24f5-4d89-a4c3-d64428c42711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a52bac9-24f5-4d89-a4c3-d64428c42711', 'volume_size': 1} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1637174690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a52bac9-24f5-4d89-a4c3-d64428c42711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f039c9145094c6ca3be2d23eccf6860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:38Z,use_quota=True,user_id='6cc7c23cf7dd41f0b02ed9e0effa1c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Creating volume 2a52bac9-24f5-4d89-a4c3-d64428c42711 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:08:38 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:08:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2a52bac9-24f5-4d89-a4c3-d64428c42711 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:38 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2a52bac9-24f5-4d89-a4c3-d64428c42711 1073741824 Jul 18 06:08:38 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:39 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2a52bac9-24f5-4d89-a4c3-d64428c42711 1073741824" returned: 0 in 0.677s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2a52bac9-24f5-4d89-a4c3-d64428c42711 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:39 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2a52bac9-24f5-4d89-a4c3-d64428c42711 Jul 18 06:08:39 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:39 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2a52bac9-24f5-4d89-a4c3-d64428c42711" returned: 0 in 0.402s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:08:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb12c532-c1bf-4603-8be8-3ffc4f9fd161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a52bac9-24f5-4d89-a4c3-d64428c42711', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110325cd-36e3-4c19-b131-89e92aa61ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Volume volume-2a52bac9-24f5-4d89-a4c3-d64428c42711 (2a52bac9-24f5-4d89-a4c3-d64428c42711): created successfully Jul 18 06:08:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110325cd-36e3-4c19-b131-89e92aa61ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Flow 'volume_create_manager' (2680d06f-0791-4bd8-b343-8a3e7cb6ab4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d81ef692-a4f8-4929-b9ea-30b8803b6bea tempest-VolumesNegativeTest-471110048 None] Created volume successfully. Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Flow 'volume_create_manager' (f1ba124d-66d4-4ed2-8ac6-234909d8cf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420c07fd-0055-4462-a46c-fc023e41a21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420c07fd-0055-4462-a46c-fc023e41a21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1628177535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fde0e0-cec9-441a-80c3-7b1ab5159e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2865cacceee947ccb700ce93dcf8ef6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:55Z,use_quota=True,user_id='eb48e9b6d9904bd5813a0ffdbf74df4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ee78c3-9704-4749-941a-beff96b068ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ee78c3-9704-4749-941a-beff96b068ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5da2886-c1a3-418e-961f-5b6f4805530f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5da2886-c1a3-418e-961f-5b6f4805530f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26fde0e0-cec9-441a-80c3-7b1ab5159e5e', 'volume_name': 'volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882af45c-a97a-4d54-9d0e-dabfc3964b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882af45c-a97a-4d54-9d0e-dabfc3964b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5093b04d-bae1-497b-be77-b472f6828509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Volume 26fde0e0-cec9-441a-80c3-7b1ab5159e5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e', 'volume_size': 1} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1628177535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fde0e0-cec9-441a-80c3-7b1ab5159e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2865cacceee947ccb700ce93dcf8ef6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:08:55Z,use_quota=True,user_id='eb48e9b6d9904bd5813a0ffdbf74df4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Creating volume 26fde0e0-cec9-441a-80c3-7b1ab5159e5e {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:08:54 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:08:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:54 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e 1073741824 Jul 18 06:08:54 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:55 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e 1073741824" returned: 0 in 0.515s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:55 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e Jul 18 06:08:55 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:55 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:08:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5093b04d-bae1-497b-be77-b472f6828509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f778f54a-7f65-4335-af76-3851e9b3df82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:08:55 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Volume volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e (26fde0e0-cec9-441a-80c3-7b1ab5159e5e): created successfully Jul 18 06:08:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f778f54a-7f65-4335-af76-3851e9b3df82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:08:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Flow 'volume_create_manager' (f1ba124d-66d4-4ed2-8ac6-234909d8cf34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:08:55 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-39fb36ae-eb56-4eba-85db-691b21ee78c0 tempest-SnapshotMetadataTestJSON-1545754862 None] Created volume successfully. Jul 18 06:08:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:08:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:08:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] Creating offline snapshot f84602a5-29d5-4bbe-8fd9-26d8b9c2107c of volume 26fde0e0-cec9-441a-80c3-7b1ab5159e5e {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:08:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[338089b5-192d-448a-8cf6-72f14482b254]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:08:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:57 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e Jul 18 06:08:57 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:57 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e" returned: 0 in 0.517s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:57 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c 1G Jul 18 06:08:57 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:58 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c 1G" returned: 0 in 0.674s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:58 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c Jul 18 06:08:58 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:58 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c" returned: 0 in 0.402s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:58 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c is being set with open permissions: ugo+rw Jul 18 06:08:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:58 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c Jul 18 06:08:58 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:59 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c" returned: 0 in 0.281s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:59 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.info Jul 18 06:08:59 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:59 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.info" returned: 0 in 0.351s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:59 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.info is being set with open permissions: ugo+rw Jul 18 06:08:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:08:59 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.info Jul 18 06:08:59 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:08:59 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Jul 18 06:08:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.info" returned: 0 in 0.269s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:08:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:08:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fd0af05b-6cca-4451-b59b-9049bd354ed1 tempest-SnapshotMetadataTestJSON-1545754862 None] Create snapshot completed successfully Jul 18 06:09:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Acquiring lock "cinder-f84602a5-29d5-4bbe-8fd9-26d8b9c2107c-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "cinder-f84602a5-29d5-4bbe-8fd9-26d8b9c2107c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Acquiring lock "cinder-quobyte-26fde0e0-cec9-441a-80c3-7b1ab5159e5e" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "cinder-quobyte-26fde0e0-cec9-441a-80c3-7b1ab5159e5e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Acquiring lock "cinder-quobyte-f84602a5-29d5-4bbe-8fd9-26d8b9c2107c" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "cinder-quobyte-f84602a5-29d5-4bbe-8fd9-26d8b9c2107c" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Deleting offline snapshot f84602a5-29d5-4bbe-8fd9-26d8b9c2107c of volume 26fde0e0-cec9-441a-80c3-7b1ab5159e5e {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:09:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] snapshot_file for this snap is: volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:09:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ed8739-af35-4ab6-b2ea-cd625c8cbcbb]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:01 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c Jul 18 06:09:01 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:02 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c" returned: 0 in 0.656s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:09:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae46c2b-9255-4fad-8284-08780461be9f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:02 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e Jul 18 06:09:02 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:02 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e" returned: 0 in 0.433s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:02 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c Jul 18 06:09:02 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:03 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c" returned: 0 in 0.421s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:03 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c Jul 18 06:09:03 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:03 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e.f84602a5-29d5-4bbe-8fd9-26d8b9c2107c" returned: 0 in 0.286s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "cinder-quobyte-f84602a5-29d5-4bbe-8fd9-26d8b9c2107c" released by "_delete_snapshot" :: held 1.976s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "cinder-quobyte-26fde0e0-cec9-441a-80c3-7b1ab5159e5e" released by "delete_snapshot" :: held 2.019s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:03 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Created reservations ['a2749a8a-15bc-4e49-952f-be5453e46d53', '608f4ff3-1010-47c2-a09f-51c182e06e49', 'b05e8ce0-057c-42d8-b4a9-a82845be0ab3', 'b689a4af-3887-45cf-ba2c-9e754cba66c1'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Delete snapshot completed successfully. Jul 18 06:09:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a2f822d1-f64a-4165-984e-1f584264477d tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "cinder-f84602a5-29d5-4bbe-8fd9-26d8b9c2107c-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Acquiring lock "cinder-26fde0e0-cec9-441a-80c3-7b1ab5159e5e-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "cinder-26fde0e0-cec9-441a-80c3-7b1ab5159e5e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Acquiring lock "cinder-quobyte-26fde0e0-cec9-441a-80c3-7b1ab5159e5e" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "cinder-quobyte-26fde0e0-cec9-441a-80c3-7b1ab5159e5e" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f315df9c-f7ba-4bf2-9a37-4116afa6f45e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:05 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e Jul 18 06:09:05 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-d774c6d2-9e3b-4b56-910d-01275887dd48 req-bc3319a2-20bd-4921-9282-8c921d08fce8 tempest-TestStampPattern-1537119279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-d774c6d2-9e3b-4b56-910d-01275887dd48 req-bc3319a2-20bd-4921-9282-8c921d08fce8 tempest-TestStampPattern-1537119279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[06178846-ee76-4121-9794-b3985f8b95f6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-d774c6d2-9e3b-4b56-910d-01275887dd48 req-bc3319a2-20bd-4921-9282-8c921d08fce8 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:05 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 Jul 18 06:09:05 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:05 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e" returned: 0 in 0.512s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:05 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e Jul 18 06:09:05 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:05 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-d774c6d2-9e3b-4b56-910d-01275887dd48 req-bc3319a2-20bd-4921-9282-8c921d08fce8 tempest-TestStampPattern-1537119279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5" returned: 0 in 0.464s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-d774c6d2-9e3b-4b56-910d-01275887dd48 req-bc3319a2-20bd-4921-9282-8c921d08fce8 tempest-TestStampPattern-1537119279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.501s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-d774c6d2-9e3b-4b56-910d-01275887dd48 req-bc3319a2-20bd-4921-9282-8c921d08fce8 tempest-TestStampPattern-1537119279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-118a9aad-e584-41d8-bf82-d8213bcf57e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd751e55-9932-47b1-8618-281c28d24993', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:09:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-d774c6d2-9e3b-4b56-910d-01275887dd48 req-bc3319a2-20bd-4921-9282-8c921d08fce8 tempest-TestStampPattern-1537119279 None] attachment_update completed successfully. Jul 18 06:09:05 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-26fde0e0-cec9-441a-80c3-7b1ab5159e5e" returned: 0 in 0.385s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "cinder-quobyte-26fde0e0-cec9-441a-80c3-7b1ab5159e5e" released by "delete_volume" :: held 0.984s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:05 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Created reservations ['0a2540c7-85a9-40a9-b74b-b830ba51c211', '8cd3a4ce-9685-4e81-8998-049bf535b647', '4a0a9abe-eed4-456d-b0bf-d0424c47db95', '058c6ca4-58fe-4486-a09c-c9f6ebf571a4'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:06 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:09:06 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:06 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.307s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:06 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:09:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Deleted volume successfully. Jul 18 06:09:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6c960c89-b38c-4a53-81c8-c7487c18d581 tempest-SnapshotMetadataTestJSON-1545754862 None] Lock "cinder-26fde0e0-cec9-441a-80c3-7b1ab5159e5e-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-301a83ef-a8f7-435a-a2c5-0dd6296ddfdb req-10949441-59d3-4b9c-bb6e-e025e5660fcd tempest-TestStampPattern-1537119279 None] Terminate volume connection completed successfully. Jul 18 06:09:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-301a83ef-a8f7-435a-a2c5-0dd6296ddfdb req-10949441-59d3-4b9c-bb6e-e025e5660fcd tempest-TestStampPattern-1537119279 None] Deleting attachment cd751e55-9932-47b1-8618-281c28d24993. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:09:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Acquiring lock "cinder-2a52bac9-24f5-4d89-a4c3-d64428c42711-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Lock "cinder-2a52bac9-24f5-4d89-a4c3-d64428c42711-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Acquiring lock "cinder-quobyte-2a52bac9-24f5-4d89-a4c3-d64428c42711" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Lock "cinder-quobyte-2a52bac9-24f5-4d89-a4c3-d64428c42711" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db88a23-ea06-4d26-91b3-ce3f2068ad88]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2a52bac9-24f5-4d89-a4c3-d64428c42711 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:09 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2a52bac9-24f5-4d89-a4c3-d64428c42711 Jul 18 06:09:09 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:09 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2a52bac9-24f5-4d89-a4c3-d64428c42711" returned: 0 in 0.473s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2a52bac9-24f5-4d89-a4c3-d64428c42711 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:09 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2a52bac9-24f5-4d89-a4c3-d64428c42711 Jul 18 06:09:09 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:10 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2a52bac9-24f5-4d89-a4c3-d64428c42711" returned: 0 in 0.406s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Lock "cinder-quobyte-2a52bac9-24f5-4d89-a4c3-d64428c42711" released by "delete_volume" :: held 0.937s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:10 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Created reservations ['d8259867-df9d-415d-bc92-1070aa4cb53b', '01f51e90-9674-4a54-bab5-a0e65cfcee93', '05d29fe8-ccb8-49e1-a7d2-27517d2633c4', 'ebe038cc-13e0-4c00-98ec-8bdf8ee8833d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:10 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:09:10 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:10 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:10 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:09:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Deleted volume successfully. Jul 18 06:09:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d3e510db-e6ed-4d2c-9510-08f484b0e211 tempest-VolumesNegativeTest-471110048 None] Lock "cinder-2a52bac9-24f5-4d89-a4c3-d64428c42711-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Flow 'volume_create_manager' (0078aa98-b423-4784-b7de-f7c6801be254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0637172-d244-4a59-b10b-6ab51e006d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0637172-d244-4a59-b10b-6ab51e006d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-27004607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3afd3a-c811-4c3b-82e3-1e22f476e3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe045c7cda441a8a58f0eaa98754f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:12Z,use_quota=True,user_id='cd5bfc83260e4555aac4bc440a13c801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1564714-f490-413c-a80e-d49e41eb6436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1564714-f490-413c-a80e-d49e41eb6436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378e6d0e-593c-4538-b1ef-377fa37115da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378e6d0e-593c-4538-b1ef-377fa37115da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e3afd3a-c811-4c3b-82e3-1e22f476e3d8', 'volume_name': 'volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a222a3a-f77e-4b4d-bd2c-80241f91803c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a222a3a-f77e-4b4d-bd2c-80241f91803c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e80e9d-8c77-4126-a811-aa6ddfb4d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Volume 5e3afd3a-c811-4c3b-82e3-1e22f476e3d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8', 'volume_size': 1} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-27004607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e3afd3a-c811-4c3b-82e3-1e22f476e3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe045c7cda441a8a58f0eaa98754f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:12Z,use_quota=True,user_id='cd5bfc83260e4555aac4bc440a13c801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Creating volume 5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:09:12 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:09:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:12 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 1073741824 Jul 18 06:09:12 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:13 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 1073741824" returned: 0 in 0.604s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:13 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 Jul 18 06:09:13 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:13 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" returned: 0 in 0.308s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e80e9d-8c77-4126-a811-aa6ddfb4d265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c286574-5c06-4a49-b19e-5fdfaf2e8009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:13 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Volume volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 (5e3afd3a-c811-4c3b-82e3-1e22f476e3d8): created successfully Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c286574-5c06-4a49-b19e-5fdfaf2e8009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Flow 'volume_create_manager' (0078aa98-b423-4784-b7de-f7c6801be254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b8935712-d959-499c-b54c-aee31e36086b tempest-VolumesDeleteCascade-2050887390 None] Created volume successfully. Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Acquiring lock "cinder-118a9aad-e584-41d8-bf82-d8213bcf57e5-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Lock "cinder-118a9aad-e584-41d8-bf82-d8213bcf57e5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Acquiring lock "cinder-quobyte-118a9aad-e584-41d8-bf82-d8213bcf57e5" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Lock "cinder-quobyte-118a9aad-e584-41d8-bf82-d8213bcf57e5" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a63cef0-8f64-47d1-a55e-150358976d7c]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:14 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 Jul 18 06:09:14 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:14 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5" returned: 0 in 0.495s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:14 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5 Jul 18 06:09:14 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] Creating offline snapshot 762accc5-276c-4028-819c-623e3f7f5cf8 of volume 5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:09:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0d0cc9-0a07-4d93-893e-511e2a2d7dbe]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:14 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-118a9aad-e584-41d8-bf82-d8213bcf57e5" returned: 0 in 0.396s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Lock "cinder-quobyte-118a9aad-e584-41d8-bf82-d8213bcf57e5" released by "delete_volume" :: held 0.962s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:14 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 Jul 18 06:09:14 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:14 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Created reservations ['948c2cf3-6b16-47dc-b98c-7b6835eb96f4', 'f0879b27-6859-4a70-83d9-6f8a7a379057', 'd06b6c54-287a-4b98-962b-21cfd6bce834', 'f9466350-0017-42c9-9788-2133029b0c0d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:15 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:09:15 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:15 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" returned: 0 in 0.617s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:15 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 1G Jul 18 06:09:15 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:15 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.364s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:09:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Deleted volume successfully. Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5dab09c0-be13-4dd6-b09f-a94c1e3a07ae tempest-TestStampPattern-1537119279 None] Lock "cinder-118a9aad-e584-41d8-bf82-d8213bcf57e5-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:15 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 1G" returned: 0 in 0.580s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:15 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 Jul 18 06:09:15 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:16 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8" returned: 0 in 0.630s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:16 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 is being set with open permissions: ugo+rw Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:16 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 Jul 18 06:09:16 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Acquiring lock "cinder-7e38247f-8bb2-4d3e-8f8f-e937c8062e23-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Lock "cinder-7e38247f-8bb2-4d3e-8f8f-e937c8062e23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Acquiring lock "cinder-quobyte-2750ba0d-f36a-4484-b666-df0caeeb00c9" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Lock "cinder-quobyte-2750ba0d-f36a-4484-b666-df0caeeb00c9" acquired by "delete_snapshot" :: waited 0.086s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Acquiring lock "cinder-quobyte-7e38247f-8bb2-4d3e-8f8f-e937c8062e23" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Lock "cinder-quobyte-7e38247f-8bb2-4d3e-8f8f-e937c8062e23" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Deleting offline snapshot 7e38247f-8bb2-4d3e-8f8f-e937c8062e23 of volume 2750ba0d-f36a-4484-b666-df0caeeb00c9 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] snapshot_file for this snap is: volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d97b3f-4b1e-47d1-a227-7d5742fe0a66]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:16 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:17 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.info Jul 18 06:09:17 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 Jul 18 06:09:17 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:17 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:17 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:17 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.info" returned: 0 in 0.325s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:17 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.info is being set with open permissions: ugo+rw Jul 18 06:09:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23" returned: 0 in 0.435s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2750ba0d-f36a-4484-b666-df0caeeb00c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:09:17 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.info Jul 18 06:09:17 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df7e27-68b4-4ebc-9ab1-d6dd7de3c819]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:17 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 Jul 18 06:09:17 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:17 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.info" returned: 0 in 0.302s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.975s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2c5eb77c-4ef7-4b80-ac2d-3d39afce2378 tempest-VolumesDeleteCascade-2050887390 None] Create snapshot completed successfully Jul 18 06:09:17 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9" returned: 0 in 0.491s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:17 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 Jul 18 06:09:17 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] Creating offline snapshot a5b7b21d-77f2-46ff-98b7-8f489907fc3b of volume 5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f87416-3bee-4ec4-90d6-040ce7173c5d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:18 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23" returned: 0 in 0.519s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:18 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 Jul 18 06:09:18 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:18 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23 Jul 18 06:09:18 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9.7e38247f-8bb2-4d3e-8f8f-e937c8062e23" returned: 0 in 0.300s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:18 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:18 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8" returned: 0 in 0.514s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Lock "cinder-quobyte-7e38247f-8bb2-4d3e-8f8f-e937c8062e23" released by "_delete_snapshot" :: held 1.998s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Lock "cinder-quobyte-2750ba0d-f36a-4484-b666-df0caeeb00c9" released by "delete_snapshot" :: held 2.043s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:18 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b 1G Jul 18 06:09:18 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:19 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Created reservations ['4230868c-308c-465f-bed1-207b61e9bbf0', '179de472-4bc2-46c7-ae5c-4f01ad502598', 'c3ba1dae-4ad1-4dd0-95f8-a05c88e49342', '6b1c3582-e6f9-44d8-b111-2c787168dcb4'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Delete snapshot completed successfully. Jul 18 06:09:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c8e218a7-3aa8-46a2-b01a-8a8ec67a69fc tempest-TestStampPattern-1537119279 None] Lock "cinder-7e38247f-8bb2-4d3e-8f8f-e937c8062e23-delete_snapshot" released by "delete_snapshot" :: held 2.518s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:19 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b 1G" returned: 0 in 1.098s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:19 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b Jul 18 06:09:19 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:20 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b" returned: 0 in 0.435s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:20 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b is being set with open permissions: ugo+rw Jul 18 06:09:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:20 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b Jul 18 06:09:20 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:20 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b" returned: 0 in 0.310s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:20 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1efb4f8e-fbb6-4c28-a828-f25d8340cbc2 tempest-VolumesDeleteCascade-2050887390 None] Create snapshot completed successfully Jul 18 06:09:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Performing cascade delete. {{(pid=87750) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 18 06:09:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-762accc5-276c-4028-819c-623e3f7f5cf8-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-762accc5-276c-4028-819c-623e3f7f5cf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-quobyte-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-quobyte-762accc5-276c-4028-819c-623e3f7f5cf8" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-762accc5-276c-4028-819c-623e3f7f5cf8" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Deleting offline snapshot 762accc5-276c-4028-819c-623e3f7f5cf8 of volume 5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:09:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] snapshot_file for this snap is: volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:09:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbe5d67-58f4-4c75-9d6e-2b9ae3376299]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:22 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 Jul 18 06:09:22 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:22 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8" returned: 0 in 0.890s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:09:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[97803d37-ef1a-4c33-b3ea-6fbd5ef95247]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:23 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 Jul 18 06:09:23 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:23 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" returned: 0 in 0.537s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9070d90e-a373-4426-b7a1-e2c28ec33f67]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:23 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b Jul 18 06:09:23 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:24 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b" returned: 0 in 0.768s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:09:24 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aa5165-9a50-485f-a15d-d9af48797924]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:24 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 Jul 18 06:09:24 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:25 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8" returned: 0 in 0.691s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:09:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b931c9f-4a5a-4d8a-8fbb-5f910f4dbc01]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:25 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 Jul 18 06:09:25 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:25 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" returned: 0 in 0.781s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:26 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 Jul 18 06:09:26 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:26 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8" returned: 0 in 0.615s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:26 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8 Jul 18 06:09:26 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:26 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.762accc5-276c-4028-819c-623e3f7f5cf8" returned: 0 in 0.420s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b -F qcow2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:27 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b -F qcow2 Jul 18 06:09:27 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:27 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b -F qcow2" returned: 0 in 0.428s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-762accc5-276c-4028-819c-623e3f7f5cf8" released by "_delete_snapshot" :: held 5.483s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" released by "delete_snapshot" :: held 5.563s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Created reservations ['b50104cf-a03c-4c6e-ac75-7c9894fcd608', 'b8f8e101-8c99-44fb-8d35-6f5aa19fc28a', 'e72ece11-6588-49f9-bba9-b7bd6c04eca1', '7745caf1-2fcf-41c7-9146-2eef075ea90a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:27 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Delete snapshot completed successfully. Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-762accc5-276c-4028-819c-623e3f7f5cf8-delete_snapshot" released by "delete_snapshot" :: held 5.862s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-a5b7b21d-77f2-46ff-98b7-8f489907fc3b-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-a5b7b21d-77f2-46ff-98b7-8f489907fc3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-quobyte-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-quobyte-a5b7b21d-77f2-46ff-98b7-8f489907fc3b" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-a5b7b21d-77f2-46ff-98b7-8f489907fc3b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Deleting offline snapshot a5b7b21d-77f2-46ff-98b7-8f489907fc3b of volume 5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] snapshot_file for this snap is: volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d4b98e-6085-46b8-b73c-4031feed9c28]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:28 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b Jul 18 06:09:28 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:28 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b" returned: 0 in 0.724s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:09:28 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[17df4fc3-e1fb-4974-bcb6-0d5d0d81eace]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:28 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 Jul 18 06:09:28 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:29 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" returned: 0 in 0.541s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:29 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b Jul 18 06:09:29 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:29 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b" returned: 0 in 0.740s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:29 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b Jul 18 06:09:29 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:30 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8.a5b7b21d-77f2-46ff-98b7-8f489907fc3b" returned: 0 in 0.397s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-a5b7b21d-77f2-46ff-98b7-8f489907fc3b" released by "_delete_snapshot" :: held 2.583s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" released by "delete_snapshot" :: held 2.616s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Created reservations ['55e1ad09-467d-4e64-be3d-69c2325d5cf7', '404e3207-0546-4a55-8e51-397a532d1320', 'e11d0e2a-1b93-4cfb-97c0-f4114bb170a4', '9329b77e-97a9-4a81-bea0-8ec73e7eaace'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:30 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Delete snapshot completed successfully. Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-a5b7b21d-77f2-46ff-98b7-8f489907fc3b-delete_snapshot" released by "delete_snapshot" :: held 3.036s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Snapshots deleted, issuing volume delete {{(pid=87750) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-quobyte-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Acquiring lock "cinder-2750ba0d-f36a-4484-b666-df0caeeb00c9-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b139a3-e394-461f-afe2-3f29d9597b8a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Lock "cinder-2750ba0d-f36a-4484-b666-df0caeeb00c9-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Acquiring lock "cinder-quobyte-2750ba0d-f36a-4484-b666-df0caeeb00c9" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Lock "cinder-quobyte-2750ba0d-f36a-4484-b666-df0caeeb00c9" acquired by "delete_volume" :: waited 0.040s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad7e625-dde6-4532-81ec-c5be4a7f256b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:31 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 Jul 18 06:09:31 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:31 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 Jul 18 06:09:31 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:31 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" returned: 0 in 0.707s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:31 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8 Jul 18 06:09:31 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:31 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9" returned: 0 in 0.539s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:31 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9 Jul 18 06:09:31 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:31 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" returned: 0 in 0.300s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8" released by "delete_volume" :: held 1.103s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:31 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2750ba0d-f36a-4484-b666-df0caeeb00c9" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:31 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Created reservations ['d39edc0c-586c-48d7-8652-0f76773aede0', '16ca27ad-87c9-4994-8f69-a3c5ca4958e6', 'a3f1cdb9-ec38-47ec-b3b9-48812221b298', '8df756e6-b441-40bc-b657-84c684d9760f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Lock "cinder-quobyte-2750ba0d-f36a-4484-b666-df0caeeb00c9" released by "delete_volume" :: held 0.973s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Created reservations ['da7418a1-d87c-46c3-b462-289250fd4dc9', 'f5a57163-4b51-4bc9-8deb-c0bef8b03d8a', '2e7bbccd-3a48-47b3-8559-8172216ef077', '51b484f0-81f0-4e38-b21b-70ff61ea5c2f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:32 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:09:32 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:32 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:09:32 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:32 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.404s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:09:32 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Deleted volume successfully. Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-77fcd114-95d7-45f1-8f02-700d3d2b31f3 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-5e3afd3a-c811-4c3b-82e3-1e22f476e3d8-delete_volume" released by "delete_volume" :: held 10.924s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:32 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.380s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:09:32 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Deleted volume successfully. Jul 18 06:09:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5d1cc98-c455-4b76-981f-3410a00b27d4 tempest-TestStampPattern-1537119279 None] Lock "cinder-2750ba0d-f36a-4484-b666-df0caeeb00c9-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:33 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:09:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Flow 'volume_create_manager' (951b969e-2362-40c5-9ff2-37e059e6d9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee263ad2-a307-4569-a6f4-4c748a6e00f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee263ad2-a307-4569-a6f4-4c748a6e00f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-270007162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2eaeba-53ab-460c-80a1-6a5200bab061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe045c7cda441a8a58f0eaa98754f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:34Z,use_quota=True,user_id='cd5bfc83260e4555aac4bc440a13c801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edb5c1c-7eb0-44a0-932d-633dde1765c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edb5c1c-7eb0-44a0-932d-633dde1765c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9121ad83-069c-435a-838a-6ab0b574c514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9121ad83-069c-435a-838a-6ab0b574c514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af2eaeba-53ab-460c-80a1-6a5200bab061', 'volume_name': 'volume-af2eaeba-53ab-460c-80a1-6a5200bab061', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652e8f38-9d7a-4f63-b5cb-471fa7d0556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652e8f38-9d7a-4f63-b5cb-471fa7d0556b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9dc99c-8e24-4836-81ab-0fecc16bae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Volume af2eaeba-53ab-460c-80a1-6a5200bab061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af2eaeba-53ab-460c-80a1-6a5200bab061', 'volume_size': 1} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-270007162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2eaeba-53ab-460c-80a1-6a5200bab061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe045c7cda441a8a58f0eaa98754f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:34Z,use_quota=True,user_id='cd5bfc83260e4555aac4bc440a13c801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Creating volume af2eaeba-53ab-460c-80a1-6a5200bab061 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:09:34 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:34 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 1073741824 Jul 18 06:09:34 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:34 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 1073741824" returned: 0 in 0.490s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:34 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 Jul 18 06:09:34 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:34 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061" returned: 0 in 0.320s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9dc99c-8e24-4836-81ab-0fecc16bae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af2eaeba-53ab-460c-80a1-6a5200bab061', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8880350-21d4-45cd-adae-7feb637019c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Volume volume-af2eaeba-53ab-460c-80a1-6a5200bab061 (af2eaeba-53ab-460c-80a1-6a5200bab061): created successfully Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8880350-21d4-45cd-adae-7feb637019c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Flow 'volume_create_manager' (951b969e-2362-40c5-9ff2-37e059e6d9ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e9d4f8db-bd8b-476f-b2ef-ff208f77ed00 tempest-VolumesDeleteCascade-2050887390 None] Created volume successfully. Jul 18 06:09:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:09:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:35 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:09:35 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:35 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:09:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:09:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:09:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:09:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] Creating offline snapshot 8000e108-cd3f-462a-972e-0205e07db7a9 of volume af2eaeba-53ab-460c-80a1-6a5200bab061 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:09:36 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1726a648-00ee-43ae-8851-39cd7de380c2]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:36 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 Jul 18 06:09:36 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:36 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061" returned: 0 in 0.384s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:36 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 1G Jul 18 06:09:36 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:37 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 1G" returned: 0 in 0.515s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af2eaeba-53ab-460c-80a1-6a5200bab061 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:37 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af2eaeba-53ab-460c-80a1-6a5200bab061 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 Jul 18 06:09:37 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:37 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af2eaeba-53ab-460c-80a1-6a5200bab061 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9" returned: 0 in 0.535s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:37 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 is being set with open permissions: ugo+rw Jul 18 06:09:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:37 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 Jul 18 06:09:37 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:37 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9" returned: 0 in 0.275s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:38 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.info Jul 18 06:09:38 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:38 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.info" returned: 0 in 0.347s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:38 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.info is being set with open permissions: ugo+rw Jul 18 06:09:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:38 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.info Jul 18 06:09:38 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:38 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.info" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.453s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:38 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=68,cinder:UPDATE=77,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:09:38 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=82,cinder:UPDATE=85,cinder:DELETE=5,cinder:INSERT=18 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:09:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fbab1a84-8fd6-4ff4-a283-a4d1b84703df tempest-VolumesDeleteCascade-2050887390 None] Create snapshot completed successfully Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Flow 'volume_create_manager' (6b3a5a60-b945-4493-894a-a06524294947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2054e9d-95ea-4236-ae76-b14d8de43ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2054e9d-95ea-4236-ae76-b14d8de43ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-584486836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49347803-b9fa-4259-8ad9-132d50173cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe045c7cda441a8a58f0eaa98754f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8000e108-cd3f-462a-972e-0205e07db7a9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:40Z,use_quota=True,user_id='cd5bfc83260e4555aac4bc440a13c801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f318d7-3108-401a-b4fb-695f835ee7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f318d7-3108-401a-b4fb-695f835ee7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f3d574-de96-4c6a-9c54-1ade494faae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7f3d574-de96-4c6a-9c54-1ade494faae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '49347803-b9fa-4259-8ad9-132d50173cb5', 'volume_name': 'volume-49347803-b9fa-4259-8ad9-132d50173cb5', 'volume_size': 1, 'snapshot_id': '8000e108-cd3f-462a-972e-0205e07db7a9'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed6834a-2afb-463d-b21b-a08daa29fb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed6834a-2afb-463d-b21b-a08daa29fb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2cdbd0-33c6-4741-8b9d-3a96ec75f29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Volume 49347803-b9fa-4259-8ad9-132d50173cb5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-49347803-b9fa-4259-8ad9-132d50173cb5', 'volume_size': 1, 'snapshot_id': '8000e108-cd3f-462a-972e-0205e07db7a9'} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-quobyte-8000e108-cd3f-462a-972e-0205e07db7a9-49347803-b9fa-4259-8ad9-132d50173cb5" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-8000e108-cd3f-462a-972e-0205e07db7a9-49347803-b9fa-4259-8ad9-132d50173cb5" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Creating volume 49347803-b9fa-4259-8ad9-132d50173cb5 from snapshot 8000e108-cd3f-462a-972e-0205e07db7a9 {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-quobyte-49347803-b9fa-4259-8ad9-132d50173cb5" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-49347803-b9fa-4259-8ad9-132d50173cb5" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] snapshot: 8000e108-cd3f-462a-972e-0205e07db7a9, volume: 49347803-b9fa-4259-8ad9-132d50173cb5, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76f0535-0632-49c1-b12a-e93dff6f33bd]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:40 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 Jul 18 06:09:40 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:40 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9" returned: 0 in 0.601s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af2eaeba-53ab-460c-80a1-6a5200bab061(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:09:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 06:09:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 06:09:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2a413d-ada1-4a39-86fe-e812a7988912]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:41 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 Jul 18 06:09:41 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:41 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061" returned: 0 in 0.472s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:41 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Path /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 06:09:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:41 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5 Jul 18 06:09:41 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:47 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5" returned: 0 in 6.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[abeec5b6-eaa2-411a-bf9e-d9d7ab98862d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:47 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 Jul 18 06:09:47 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:48 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061" returned: 0 in 0.747s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:09:48 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Converted 1024.00 MB image at 163.60 MB/s Jul 18 06:09:48 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5 is being set with open permissions: ugo+rw Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:48 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5 Jul 18 06:09:48 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Flow 'volume_create_manager' (6fa7845c-d691-4cbd-9a7d-5be5e04f333f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2572e9f6-30a1-4129-b20f-ff39f32c42bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2572e9f6-30a1-4129-b20f-ff39f32c42bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1527766374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5638255340a49daaf603f9099009497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:49Z,use_quota=True,user_id='4ff8f21b0b144849835b16e8aed3b79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c765eb9-1d4a-459b-80ff-d0ca3ef306d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c765eb9-1d4a-459b-80ff-d0ca3ef306d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7918338b-fd96-42d4-9648-106ee358d15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7918338b-fd96-42d4-9648-106ee358d15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3', 'volume_name': 'volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee39673-a2b2-4869-adeb-705e2f30e049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee39673-a2b2-4869-adeb-705e2f30e049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2990c6-7639-49e3-8473-e444c6bd6793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:48 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Volume 7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3', 'volume_size': 1} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:48 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5" returned: 0 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-49347803-b9fa-4259-8ad9-132d50173cb5" released by "_copy_volume_from_snapshot" :: held 8.547s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-8000e108-cd3f-462a-972e-0205e07db7a9-49347803-b9fa-4259-8ad9-132d50173cb5" released by "_create_volume_from_snapshot" :: held 8.586s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.610s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1527766374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5638255340a49daaf603f9099009497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:49Z,use_quota=True,user_id='4ff8f21b0b144849835b16e8aed3b79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Creating volume 7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:09:48 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:48 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3 1073741824 Jul 18 06:09:48 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2cdbd0-33c6-4741-8b9d-3a96ec75f29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49347803-b9fa-4259-8ad9-132d50173cb5', 'volume_size': 1, 'snapshot_id': '8000e108-cd3f-462a-972e-0205e07db7a9'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d117ccc-e0c0-4e22-916b-c7fce34b5b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:48 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Volume volume-49347803-b9fa-4259-8ad9-132d50173cb5 (49347803-b9fa-4259-8ad9-132d50173cb5): created successfully Jul 18 06:09:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d117ccc-e0c0-4e22-916b-c7fce34b5b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Flow 'volume_create_manager' (6b3a5a60-b945-4493-894a-a06524294947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e405720e-b1a0-4477-b87b-844fc6edf10e tempest-VolumesDeleteCascade-2050887390 None] Created volume successfully. Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-af2eaeba-53ab-460c-80a1-6a5200bab061-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-af2eaeba-53ab-460c-80a1-6a5200bab061-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Flow 'volume_create_manager' (5ecc8c28-fcc2-4fc0-acd3-f09535f32e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f05d95b-465f-44cd-9d06-eb76eb6af673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Performing cascade delete. {{(pid=87750) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f05d95b-465f-44cd-9d06-eb76eb6af673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-557411213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8ce524-5db9-491a-8348-b859e10a3a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058a006a1fcb4d0992b60edbaa9aefaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:49Z,use_quota=True,user_id='334ddb9ebb4a422d8a51304107a0dc04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e38464e8-60ff-484a-8319-b362426b7f19),volume_type_id=e38464e8-60ff-484a-8319-b362426b7f19)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1785064-222b-4b96-bad9-55f219d5a986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1785064-222b-4b96-bad9-55f219d5a986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1603c5-417f-464e-a226-0b4626d272bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1603c5-417f-464e-a226-0b4626d272bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec8ce524-5db9-491a-8348-b859e10a3a21', 'volume_name': 'volume-ec8ce524-5db9-491a-8348-b859e10a3a21', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4d7be9-0599-4954-a508-4150d8f6cd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4d7be9-0599-4954-a508-4150d8f6cd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d9bbd2-b545-450a-9b4f-6894cfff9b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Volume ec8ce524-5db9-491a-8348-b859e10a3a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec8ce524-5db9-491a-8348-b859e10a3a21', 'volume_size': 1} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-8000e108-cd3f-462a-972e-0205e07db7a9-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:49 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3 1073741824" returned: 0 in 0.740s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-8000e108-cd3f-462a-972e-0205e07db7a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-quobyte-af2eaeba-53ab-460c-80a1-6a5200bab061" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-af2eaeba-53ab-460c-80a1-6a5200bab061" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-quobyte-8000e108-cd3f-462a-972e-0205e07db7a9" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-8000e108-cd3f-462a-972e-0205e07db7a9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:49 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3 Jul 18 06:09:49 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Deleting offline snapshot 8000e108-cd3f-462a-972e-0205e07db7a9 of volume af2eaeba-53ab-460c-80a1-6a5200bab061 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] snapshot_file for this snap is: volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6aa7c9e-4cce-4d1f-bf96-abd1f761ded5]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:50 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 Jul 18 06:09:50 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:09:50 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Flow 'volume_create_manager' (f5877ba8-adca-47f7-b4b2-819c12d6eba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f2253f-cbdd-4c8d-aa2a-391e24f96bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3" returned: 0 in 0.495s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-557411213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8ce524-5db9-491a-8348-b859e10a3a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058a006a1fcb4d0992b60edbaa9aefaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:49Z,use_quota=True,user_id='334ddb9ebb4a422d8a51304107a0dc04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e38464e8-60ff-484a-8319-b362426b7f19),volume_type_id=e38464e8-60ff-484a-8319-b362426b7f19)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Creating volume ec8ce524-5db9-491a-8348-b859e10a3a21 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:09:50 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ec8ce524-5db9-491a-8348-b859e10a3a21 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c2990c6-7639-49e3-8473-e444c6bd6793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe14943-a1a0-40a3-b4d4-d5f1e811848c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f2253f-cbdd-4c8d-aa2a-391e24f96bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-485797422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14e72d5-d189-468b-b683-3d27b3ad9d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058a006a1fcb4d0992b60edbaa9aefaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:50Z,use_quota=True,user_id='334ddb9ebb4a422d8a51304107a0dc04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff4a178d-8a5f-48d0-8f43-55b0ef5bd373),volume_type_id=ff4a178d-8a5f-48d0-8f43-55b0ef5bd373)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c19ac0-000a-4d22-93d6-3f06de59d11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:50 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ec8ce524-5db9-491a-8348-b859e10a3a21 1073741824 Jul 18 06:09:50 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c19ac0-000a-4d22-93d6-3f06de59d11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb310da4-9cab-4b1f-b7f5-755532fc928a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb310da4-9cab-4b1f-b7f5-755532fc928a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c14e72d5-d189-468b-b683-3d27b3ad9d0b', 'volume_name': 'volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e713c81-5cef-46aa-b5f9-58aa18590261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e713c81-5cef-46aa-b5f9-58aa18590261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db42455a-ac6d-492d-af5e-05da77ef6981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Volume c14e72d5-d189-468b-b683-3d27b3ad9d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b', 'volume_size': 1} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Volume volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3 (7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3): created successfully Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe14943-a1a0-40a3-b4d4-d5f1e811848c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Flow 'volume_create_manager' (6fa7845c-d691-4cbd-9a7d-5be5e04f333f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-27fdd377-2cfa-429d-8221-3b9ad960f8d6 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Created volume successfully. Jul 18 06:09:50 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9" returned: 0 in 0.617s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af2eaeba-53ab-460c-80a1-6a5200bab061(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3840d81-0efa-4c29-a736-cdcab0d0d85f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:50 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 Jul 18 06:09:50 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:50 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Flow 'volume_create_manager' (348cf032-9b1f-4f28-b0bf-42cb1fb66384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dff5dc-28d1-4301-a625-5aff35dd42a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ec8ce524-5db9-491a-8348-b859e10a3a21 1073741824" returned: 0 in 0.682s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dff5dc-28d1-4301-a625-5aff35dd42a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1880934149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce72d38f-ec8b-49e6-bebe-a371cf5fcac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058a006a1fcb4d0992b60edbaa9aefaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:51Z,use_quota=True,user_id='334ddb9ebb4a422d8a51304107a0dc04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a07a2a53-98cd-4f5f-b2e9-68c93fe7c960),volume_type_id=a07a2a53-98cd-4f5f-b2e9-68c93fe7c960)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f46ff8-5184-41b3-b724-ac757b2a1a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10f46ff8-5184-41b3-b724-ac757b2a1a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeac0784-33e9-4a78-964a-d2f23d4b0ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:50 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ec8ce524-5db9-491a-8348-b859e10a3a21 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:51 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ec8ce524-5db9-491a-8348-b859e10a3a21 Jul 18 06:09:51 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061" returned: 0 in 0.575s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:51 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:51 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 Jul 18 06:09:51 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeac0784-33e9-4a78-964a-d2f23d4b0ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ce72d38f-ec8b-49e6-bebe-a371cf5fcac9', 'volume_name': 'volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9', 'volume_size': 1, 'image_id': 'ebb4a179-4ab0-4ec0-8508-7503951b7964', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebb4a179-4ab0-4ec0-8508-7503951b7964', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1316513056', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '058a006a1fcb4d0992b60edbaa9aefaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ebb4a179-4ab0-4ec0-8508-7503951b7964', 'created_at': datetime.datetime(2026, 7, 18, 4, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 9, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebb4a179-4ab0-4ec0-8508-7503951b7964/file', 'properties': {}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95682ef7-d5cc-41bd-adf2-c9e4f764721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:51 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95682ef7-d5cc-41bd-adf2-c9e4f764721d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567c96c1-a09f-4783-8f67-9c995f65b221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:51 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Volume ce72d38f-ec8b-49e6-bebe-a371cf5fcac9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9', 'volume_size': 1, 'image_id': 'ebb4a179-4ab0-4ec0-8508-7503951b7964', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebb4a179-4ab0-4ec0-8508-7503951b7964', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1316513056', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '058a006a1fcb4d0992b60edbaa9aefaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ebb4a179-4ab0-4ec0-8508-7503951b7964', 'created_at': datetime.datetime(2026, 7, 18, 4, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 9, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebb4a179-4ab0-4ec0-8508-7503951b7964/file', 'properties': {}}, 'image_service': } Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Trying to clone ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 from image ebb4a179-4ab0-4ec0-8508-7503951b7964 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ebb4a179-4ab0-4ec0-8508-7503951b7964', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ec8ce524-5db9-491a-8348-b859e10a3a21" returned: 0 in 0.539s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.214s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-485797422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14e72d5-d189-468b-b683-3d27b3ad9d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058a006a1fcb4d0992b60edbaa9aefaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:50Z,use_quota=True,user_id='334ddb9ebb4a422d8a51304107a0dc04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff4a178d-8a5f-48d0-8f43-55b0ef5bd373),volume_type_id=ff4a178d-8a5f-48d0-8f43-55b0ef5bd373)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Creating volume c14e72d5-d189-468b-b683-3d27b3ad9d0b {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:09:51 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d9bbd2-b545-450a-9b4f-6894cfff9b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec8ce524-5db9-491a-8348-b859e10a3a21', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd273c92-7fa3-44ae-8f5d-f0a3d764d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:51 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b 1073741824 Jul 18 06:09:51 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:51 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Volume volume-ec8ce524-5db9-491a-8348-b859e10a3a21 (ec8ce524-5db9-491a-8348-b859e10a3a21): created successfully Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd273c92-7fa3-44ae-8f5d-f0a3d764d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Flow 'volume_create_manager' (5ecc8c28-fcc2-4fc0-acd3-f09535f32e60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:51 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9" returned: 0 in 0.623s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8d74227b-08e7-4ac6-855f-a21b81cc5252 tempest-TestInstancesWithCinderVolumes-601950587 None] Created volume successfully. Jul 18 06:09:51 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9 Jul 18 06:09:51 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:52 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061.8000e108-cd3f-462a-972e-0205e07db7a9" returned: 0 in 0.463s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-8000e108-cd3f-462a-972e-0205e07db7a9" released by "_delete_snapshot" :: held 2.487s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-af2eaeba-53ab-460c-80a1-6a5200bab061" released by "delete_snapshot" :: held 2.532s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:52 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b 1073741824" returned: 0 in 0.749s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-e51dfb96-e0b2-4c6d-9695-20ed4fee1e64 req-fe3c1a0e-acf3-4319-9b9c-981f7fbee358 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Created reservations ['d1a5e6bf-6b68-4d6e-be28-7438f3bbaf1e', '7568cd6d-4e10-40a2-86ee-d0b6c660d02f', '0cf724cf-4959-4b04-b211-385f3048de17', '86239870-2be5-4e5c-91bb-e128235af343'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:52 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b Jul 18 06:09:52 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Delete snapshot completed successfully. Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-8000e108-cd3f-462a-972e-0205e07db7a9-delete_snapshot" released by "delete_snapshot" :: held 2.824s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Snapshots deleted, issuing volume delete {{(pid=87750) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-quobyte-af2eaeba-53ab-460c-80a1-6a5200bab061" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-af2eaeba-53ab-460c-80a1-6a5200bab061" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf98bab-934a-4722-8708-6874b29ce330]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:52 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 Jul 18 06:09:52 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:52 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b" returned: 0 in 0.352s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-e51dfb96-e0b2-4c6d-9695-20ed4fee1e64 req-fe3c1a0e-acf3-4319-9b9c-981f7fbee358 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.412s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db42455a-ac6d-492d-af5e-05da77ef6981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66610839-1868-4692-b376-695518342450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-e51dfb96-e0b2-4c6d-9695-20ed4fee1e64 req-fe3c1a0e-acf3-4319-9b9c-981f7fbee358 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.065s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:52 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Volume volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b (c14e72d5-d189-468b-b683-3d27b3ad9d0b): created successfully Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66610839-1868-4692-b376-695518342450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Flow 'volume_create_manager' (f5877ba8-adca-47f7-b4b2-819c12d6eba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4a441c18-c356-4cfb-a002-2381d1926529 tempest-TestInstancesWithCinderVolumes-601950587 None] Created volume successfully. Jul 18 06:09:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-e51dfb96-e0b2-4c6d-9695-20ed4fee1e64 req-fe3c1a0e-acf3-4319-9b9c-981f7fbee358 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5f4fd05-5c57-412c-8613-1eadb1e8775f', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:09:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-e51dfb96-e0b2-4c6d-9695-20ed4fee1e64 req-fe3c1a0e-acf3-4319-9b9c-981f7fbee358 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] attachment_update completed successfully. Jul 18 06:09:53 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061" returned: 0 in 0.594s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:53 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061 Jul 18 06:09:53 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:53 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af2eaeba-53ab-460c-80a1-6a5200bab061" returned: 0 in 0.366s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-af2eaeba-53ab-460c-80a1-6a5200bab061" released by "delete_volume" :: held 1.032s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:53 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Created reservations ['45ce78da-9f37-49af-89a7-496dc8947d7b', '3957cfe8-61a8-4883-98ff-6fbea4af84d0', 'a7c50c8f-6593-4317-873d-feab4aba144a', '199d7e58-8aba-498e-9fbb-24d1d4a27626'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:53 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:09:53 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:54 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.521s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:54 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:09:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Deleted volume successfully. Jul 18 06:09:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82968efe-69af-4dd7-a789-9a662fab43f4 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-af2eaeba-53ab-460c-80a1-6a5200bab061-delete_volume" released by "delete_volume" :: held 4.874s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-49347803-b9fa-4259-8ad9-132d50173cb5-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-49347803-b9fa-4259-8ad9-132d50173cb5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "cinder-quobyte-49347803-b9fa-4259-8ad9-132d50173cb5" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-49347803-b9fa-4259-8ad9-132d50173cb5" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:54 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cfb27f-e73a-420f-9df2-eed79ac745ab]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:54 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5 Jul 18 06:09:54 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:54 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5" returned: 0 in 0.419s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:54 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5 Jul 18 06:09:54 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:55 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-49347803-b9fa-4259-8ad9-132d50173cb5" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-quobyte-49347803-b9fa-4259-8ad9-132d50173cb5" released by "delete_volume" :: held 0.722s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:55 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Created reservations ['59f62a2c-9c39-4cd7-90ae-78efb67db751', '5816a21d-b787-404e-97cd-99e3310a23a7', '7f3afa19-cedf-4358-a715-7e7307dcedcf', '66a456d6-5ec0-4013-b8da-ae2cc97483ff'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:55 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:09:55 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:55 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.309s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:55 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:09:55 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Deleted volume successfully. Jul 18 06:09:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fb29eec4-4ace-4a52-8647-ec4fe1a88718 tempest-VolumesDeleteCascade-2050887390 None] Lock "cinder-49347803-b9fa-4259-8ad9-132d50173cb5-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:56 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD, size 20.69 MB, duration 5.32 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 06:09:56 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Image download 20.69 MB at 3.89 MB/s Jul 18 06:09:56 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cadb1e-0ef1-49e3-b1d2-47c124ece5ba]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:57 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD Jul 18 06:09:57 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:57 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD" returned: 0 in 0.623s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Temporary image ebb4a179-4ab0-4ec0-8508-7503951b7964 is fetched for user 334ddb9ebb4a422d8a51304107a0dc04. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Flow 'volume_create_manager' (9da13086-78c4-4153-89c0-749e0e17b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a484c2-0f47-4419-ae6f-7e51625082c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a484c2-0f47-4419-ae6f-7e51625082c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1860860535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e297e0fd-7165-4016-8a0c-e2980a6acf63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c76ad38ecf45e2b4044340df79f298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:58Z,use_quota=True,user_id='f31bcef474ee4fc19b5c8e477fe61dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085892dd-7a8e-43b2-8e89-9f79bd019be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085892dd-7a8e-43b2-8e89-9f79bd019be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b8531d-12b2-4eca-b8aa-026e131ca816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b8531d-12b2-4eca-b8aa-026e131ca816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e297e0fd-7165-4016-8a0c-e2980a6acf63', 'volume_name': 'volume-e297e0fd-7165-4016-8a0c-e2980a6acf63', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9578b24c-a07d-4368-97e9-464ded3a2b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9578b24c-a07d-4368-97e9-464ded3a2b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c2e6ce-81a3-4f3e-be3b-b056b3b38e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Volume e297e0fd-7165-4016-8a0c-e2980a6acf63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e297e0fd-7165-4016-8a0c-e2980a6acf63', 'volume_size': 1} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1860860535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e297e0fd-7165-4016-8a0c-e2980a6acf63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c76ad38ecf45e2b4044340df79f298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:58Z,use_quota=True,user_id='f31bcef474ee4fc19b5c8e477fe61dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Creating volume e297e0fd-7165-4016-8a0c-e2980a6acf63 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:09:57 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e297e0fd-7165-4016-8a0c-e2980a6acf63 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:57 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e297e0fd-7165-4016-8a0c-e2980a6acf63 1073741824 Jul 18 06:09:57 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e74ae3-eea6-48da-ae9d-5073f2a44c1a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-8d4683df-55f8-48a4-a511-29f6874a4836 req-6d53088f-0226-48cb-987a-6e93c1ec6f81 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Terminate volume connection completed successfully. Jul 18 06:09:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-8d4683df-55f8-48a4-a511-29f6874a4836 req-6d53088f-0226-48cb-987a-6e93c1ec6f81 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Deleting attachment f5f4fd05-5c57-412c-8613-1eadb1e8775f. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:09:57 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD Jul 18 06:09:57 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:58 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:58 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e297e0fd-7165-4016-8a0c-e2980a6acf63 1073741824" returned: 0 in 0.581s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e297e0fd-7165-4016-8a0c-e2980a6acf63 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:58 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e297e0fd-7165-4016-8a0c-e2980a6acf63 Jul 18 06:09:58 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:58 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e297e0fd-7165-4016-8a0c-e2980a6acf63" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.407s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1880934149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce72d38f-ec8b-49e6-bebe-a371cf5fcac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='058a006a1fcb4d0992b60edbaa9aefaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:09:51Z,use_quota=True,user_id='334ddb9ebb4a422d8a51304107a0dc04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a07a2a53-98cd-4f5f-b2e9-68c93fe7c960),volume_type_id=a07a2a53-98cd-4f5f-b2e9-68c93fe7c960)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Creating volume ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:09:58 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c2e6ce-81a3-4f3e-be3b-b056b3b38e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e297e0fd-7165-4016-8a0c-e2980a6acf63', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:58 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 1073741824 Jul 18 06:09:58 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a567d80e-9c22-4076-8ee5-a650b28c444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:09:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Volume volume-e297e0fd-7165-4016-8a0c-e2980a6acf63 (e297e0fd-7165-4016-8a0c-e2980a6acf63): created successfully Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a567d80e-9c22-4076-8ee5-a650b28c444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Flow 'volume_create_manager' (9da13086-78c4-4153-89c0-749e0e17b949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Acquiring lock "cinder-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0c2d2bd0-7cff-44c0-a17f-c9c2a913bd3b tempest-ProjectReaderTests-1070281175 None] Created volume successfully. Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Lock "cinder-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Acquiring lock "cinder-quobyte-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Lock "cinder-quobyte-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[452f92c8-c55f-44dd-be60-5754d157c164]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:58 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3 Jul 18 06:09:58 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:59 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 1073741824" returned: 0 in 0.526s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:59 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 Jul 18 06:09:59 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:59 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3" returned: 0 in 0.466s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:59 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3 Jul 18 06:09:59 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:59 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9" returned: 0 in 0.280s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Attempting download of ebb4a179-4ab0-4ec0-8508-7503951b7964 ((None, [{'url': 'file:///opt/stack/data/glance/images/ebb4a179-4ab0-4ec0-8508-7503951b7964', 'metadata': {}}])) to volume ce72d38f-ec8b-49e6-bebe-a371cf5fcac9. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[55926977-96a5-4191-93db-e2fd9fffaade]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebb4a179-4ab0-4ec0-8508-7503951b7964_g10ajnwd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:59 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Lock "cinder-quobyte-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3" released by "delete_volume" :: held 0.817s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Created reservations ['74cf8fc0-b69c-4d8c-bb42-57bb92b7c50c', 'f59749e2-2248-4f09-945a-ca2a7a079f14', 'd287ad97-e9c0-4938-9a5f-aa9e5b205a2f', '19affc83-9218-424f-bae0-181a7a16d841'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:09:59 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebb4a179-4ab0-4ec0-8508-7503951b7964_g10ajnwd Jul 18 06:09:59 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:09:59 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:09:59 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Acquiring lock "cinder-e297e0fd-7165-4016-8a0c-e2980a6acf63-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:09:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Lock "cinder-e297e0fd-7165-4016-8a0c-e2980a6acf63-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Acquiring lock "cinder-quobyte-e297e0fd-7165-4016-8a0c-e2980a6acf63" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Lock "cinder-quobyte-e297e0fd-7165-4016-8a0c-e2980a6acf63" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9dc862-75d5-43f6-a287-c984b7f46b45]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e297e0fd-7165-4016-8a0c-e2980a6acf63 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:00 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:00 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebb4a179-4ab0-4ec0-8508-7503951b7964_g10ajnwd" returned: 0 in 0.562s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebb4a179-4ab0-4ec0-8508-7503951b7964_g10ajnwd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Deleted volume successfully. Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0e59859f-6292-40db-ad58-56a6fdde8109 tempest-TestServerVolumeAttachScenarioOldVersion-443788190 None] Lock "cinder-7f18d88e-4bf6-4aaf-b393-a8ed0ee4c1e3-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:00 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e297e0fd-7165-4016-8a0c-e2980a6acf63 Jul 18 06:10:00 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:00 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebb4a179-4ab0-4ec0-8508-7503951b7964_g10ajnwd Jul 18 06:10:00 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:00 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebb4a179-4ab0-4ec0-8508-7503951b7964_g10ajnwd" returned: 1 in 0.610s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebb4a179-4ab0-4ec0-8508-7503951b7964_g10ajnwd' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0383ebf5-f4a4-4f40-beab-618c7a0bdf50]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:00 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e297e0fd-7165-4016-8a0c-e2980a6acf63" returned: 0 in 0.681s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e297e0fd-7165-4016-8a0c-e2980a6acf63 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:00 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e297e0fd-7165-4016-8a0c-e2980a6acf63 Jul 18 06:10:00 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:00 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD Jul 18 06:10:00 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:01 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e297e0fd-7165-4016-8a0c-e2980a6acf63" returned: 0 in 0.366s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:01 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] ebb4a179-4ab0-4ec0-8508-7503951b7964 was qcow2, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Lock "cinder-quobyte-e297e0fd-7165-4016-8a0c-e2980a6acf63" released by "delete_volume" :: held 1.165s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:01 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 Jul 18 06:10:01 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Created reservations ['f1677925-1863-441f-a5dc-60e59742d954', 'dde5d13c-8e9a-4874-affb-c2e4f93a6715', 'e9e04228-b40f-4a61-9184-2adb1fb706c1', '5800a9fc-44a7-4ce4-b555-8c49e28ffa9f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:01 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:01 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Flow 'volume_create_manager' (a0941f51-f652-41b7-812e-16593d77328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0288cb1-b184-4eb1-9603-9210d90156f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0288cb1-b184-4eb1-9603-9210d90156f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1711142031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9af88ab-a3fa-4204-9dce-7afedb9df446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0af9fdcb553465aada8744a8caf3764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:02Z,use_quota=True,user_id='8c7df143031746cd9616d06fce37d9da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75f8ef7-1241-48ed-942a-2e24e72476fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75f8ef7-1241-48ed-942a-2e24e72476fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28671d62-203e-4925-966b-67a396988918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28671d62-203e-4925-966b-67a396988918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9af88ab-a3fa-4204-9dce-7afedb9df446', 'volume_name': 'volume-e9af88ab-a3fa-4204-9dce-7afedb9df446', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abc0972-5493-46a4-8004-7376fe543869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abc0972-5493-46a4-8004-7376fe543869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4498759e-c867-484a-b409-61a9e5c2b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:01 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Volume e9af88ab-a3fa-4204-9dce-7afedb9df446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9af88ab-a3fa-4204-9dce-7afedb9df446', 'volume_size': 1} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1711142031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9af88ab-a3fa-4204-9dce-7afedb9df446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0af9fdcb553465aada8744a8caf3764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:02Z,use_quota=True,user_id='8c7df143031746cd9616d06fce37d9da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Creating volume e9af88ab-a3fa-4204-9dce-7afedb9df446 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:01 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e9af88ab-a3fa-4204-9dce-7afedb9df446 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:01 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e9af88ab-a3fa-4204-9dce-7afedb9df446 1073741824 Jul 18 06:10:01 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:01 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.454s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:01 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Deleted volume successfully. Jul 18 06:10:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0ebbfbac-023e-4980-b7b9-392669183454 tempest-ProjectReaderTests-1070281175 None] Lock "cinder-e297e0fd-7165-4016-8a0c-e2980a6acf63-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:02 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e9af88ab-a3fa-4204-9dce-7afedb9df446 1073741824" returned: 0 in 0.726s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e9af88ab-a3fa-4204-9dce-7afedb9df446 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:02 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e9af88ab-a3fa-4204-9dce-7afedb9df446 Jul 18 06:10:02 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Flow 'volume_create_manager' (16410162-07f8-49d0-8363-c448b9b7bf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:03 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c85e564-8385-4412-ba13-15f40239be4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e9af88ab-a3fa-4204-9dce-7afedb9df446" returned: 0 in 0.493s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c85e564-8385-4412-ba13-15f40239be4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000916845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3ef939-c297-4d91-a358-593c3eec3b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c76ad38ecf45e2b4044340df79f298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:03Z,use_quota=True,user_id='f31bcef474ee4fc19b5c8e477fe61dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9ade43-f915-4ebd-8df4-38500ca472ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed9ade43-f915-4ebd-8df4-38500ca472ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24ad9fd-c846-4596-b085-79e741c454ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24ad9fd-c846-4596-b085-79e741c454ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf3ef939-c297-4d91-a358-593c3eec3b35', 'volume_name': 'volume-cf3ef939-c297-4d91-a358-593c3eec3b35', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dc1c37-0c46-41d7-a7e1-7e545486fd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dc1c37-0c46-41d7-a7e1-7e545486fd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddc9477-dd5b-411a-bdec-ec3ee24317d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Volume cf3ef939-c297-4d91-a358-593c3eec3b35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf3ef939-c297-4d91-a358-593c3eec3b35', 'volume_size': 1} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000916845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf3ef939-c297-4d91-a358-593c3eec3b35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c76ad38ecf45e2b4044340df79f298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:03Z,use_quota=True,user_id='f31bcef474ee4fc19b5c8e477fe61dd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Creating volume cf3ef939-c297-4d91-a358-593c3eec3b35 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:03 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf3ef939-c297-4d91-a358-593c3eec3b35 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4498759e-c867-484a-b409-61a9e5c2b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9af88ab-a3fa-4204-9dce-7afedb9df446', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85162049-78b3-4977-b721-7b4b1afdbac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:03 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf3ef939-c297-4d91-a358-593c3eec3b35 1073741824 Jul 18 06:10:03 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Volume volume-e9af88ab-a3fa-4204-9dce-7afedb9df446 (e9af88ab-a3fa-4204-9dce-7afedb9df446): created successfully Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85162049-78b3-4977-b721-7b4b1afdbac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Flow 'volume_create_manager' (a0941f51-f652-41b7-812e-16593d77328d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-56339b5d-42d2-4b2e-9393-8f5ba2e72e59 tempest-VolumesTransfersTest-1682245531 None] Created volume successfully. Jul 18 06:10:04 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf3ef939-c297-4d91-a358-593c3eec3b35 1073741824" returned: 0 in 0.714s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf3ef939-c297-4d91-a358-593c3eec3b35 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:04 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf3ef939-c297-4d91-a358-593c3eec3b35 Jul 18 06:10:04 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:04 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9" returned: 0 in 2.931s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ebb4a179-4ab0-4ec0-8508-7503951b7964_kssdsktudevstack@QuobyteHD, size 112.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:10:04 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Converted 112.00 MB image at 38.19 MB/s Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:04 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 1G Jul 18 06:10:04 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:04 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf3ef939-c297-4d91-a358-593c3eec3b35" returned: 0 in 0.296s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddc9477-dd5b-411a-bdec-ec3ee24317d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf3ef939-c297-4d91-a358-593c3eec3b35', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46392a56-0a09-4cb1-bfa2-458024cc0254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Volume volume-cf3ef939-c297-4d91-a358-593c3eec3b35 (cf3ef939-c297-4d91-a358-593c3eec3b35): created successfully Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46392a56-0a09-4cb1-bfa2-458024cc0254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Flow 'volume_create_manager' (16410162-07f8-49d0-8363-c448b9b7bf28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-157d7c0d-22c2-44c1-8b01-a29957d4129e tempest-ProjectReaderTests-1070281175 None] Created volume successfully. Jul 18 06:10:04 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 1G" returned: 0 in 0.373s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Downloaded image ebb4a179-4ab0-4ec0-8508-7503951b7964 ((None, [{'url': 'file:///opt/stack/data/glance/images/ebb4a179-4ab0-4ec0-8508-7503951b7964', 'metadata': {}}])) to volume ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Temporary image ebb4a179-4ab0-4ec0-8508-7503951b7964 for user 334ddb9ebb4a422d8a51304107a0dc04 is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Marking volume ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Copying metadata from image ebb4a179-4ab0-4ec0-8508-7503951b7964 to ce72d38f-ec8b-49e6-bebe-a371cf5fcac9. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Creating volume glance metadata for volume ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 backed by image ebb4a179-4ab0-4ec0-8508-7503951b7964 with: {'image_id': 'ebb4a179-4ab0-4ec0-8508-7503951b7964', 'image_name': 'tempest-scenario-img--1316513056', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567c96c1-a09f-4783-8f67-9c995f65b221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9', 'volume_size': 1, 'image_id': 'ebb4a179-4ab0-4ec0-8508-7503951b7964', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebb4a179-4ab0-4ec0-8508-7503951b7964', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1316513056', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '058a006a1fcb4d0992b60edbaa9aefaa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ebb4a179-4ab0-4ec0-8508-7503951b7964', 'created_at': datetime.datetime(2026, 7, 18, 4, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 9, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebb4a179-4ab0-4ec0-8508-7503951b7964/file', 'properties': {}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fdc5d88-2932-4382-9548-5331521986a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-56a9b723-7911-45fc-b5cc-43c32eb2c14e tempest-VolumesTransfersTest-706461173 None] Transfer volume completed successfully. Jul 18 06:10:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Volume volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 (ce72d38f-ec8b-49e6-bebe-a371cf5fcac9): created successfully Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fdc5d88-2932-4382-9548-5331521986a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Flow 'volume_create_manager' (348cf032-9b1f-4f28-b0bf-42cb1fb66384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e3e7cc96-1621-498a-8835-c29c7bab9e3c tempest-TestInstancesWithCinderVolumes-601950587 None] Created volume successfully. Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Acquiring lock "cinder-e9af88ab-a3fa-4204-9dce-7afedb9df446-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Lock "cinder-e9af88ab-a3fa-4204-9dce-7afedb9df446-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Acquiring lock "cinder-cf3ef939-c297-4d91-a358-593c3eec3b35-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Lock "cinder-cf3ef939-c297-4d91-a358-593c3eec3b35-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Acquiring lock "cinder-quobyte-e9af88ab-a3fa-4204-9dce-7afedb9df446" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Lock "cinder-quobyte-e9af88ab-a3fa-4204-9dce-7afedb9df446" acquired by "delete_volume" :: waited 0.044s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Acquiring lock "cinder-quobyte-cf3ef939-c297-4d91-a358-593c3eec3b35" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71fe9ee-ba42-4447-93ff-ec467294aef4]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e9af88ab-a3fa-4204-9dce-7afedb9df446 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Lock "cinder-quobyte-cf3ef939-c297-4d91-a358-593c3eec3b35" acquired by "delete_volume" :: waited 0.040s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[774afac9-b075-415f-8b8f-92f5654d3797]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf3ef939-c297-4d91-a358-593c3eec3b35 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:05 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e9af88ab-a3fa-4204-9dce-7afedb9df446 Jul 18 06:10:05 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:05 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf3ef939-c297-4d91-a358-593c3eec3b35 Jul 18 06:10:05 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:05 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e9af88ab-a3fa-4204-9dce-7afedb9df446" returned: 0 in 0.453s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e9af88ab-a3fa-4204-9dce-7afedb9df446 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:05 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf3ef939-c297-4d91-a358-593c3eec3b35" returned: 0 in 0.441s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf3ef939-c297-4d91-a358-593c3eec3b35 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:05 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e9af88ab-a3fa-4204-9dce-7afedb9df446 Jul 18 06:10:05 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:05 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf3ef939-c297-4d91-a358-593c3eec3b35 Jul 18 06:10:05 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:06 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf3ef939-c297-4d91-a358-593c3eec3b35" returned: 0 in 0.275s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:06 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e9af88ab-a3fa-4204-9dce-7afedb9df446" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Lock "cinder-quobyte-cf3ef939-c297-4d91-a358-593c3eec3b35" released by "delete_volume" :: held 0.775s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Lock "cinder-quobyte-e9af88ab-a3fa-4204-9dce-7afedb9df446" released by "delete_volume" :: held 0.856s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Created reservations ['bda789dc-9f5c-4c43-a308-ec4445a59b94', '2a90ef47-7352-45d4-b8a7-411bdfa1afce', '0918663e-7f84-45ef-b77a-6ebf4373e65a', '9aa3adb2-7ad9-4317-b0d5-cb29e064508d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Created reservations ['61bed9c9-b336-4111-a0f4-db137b686bf1', 'b938969c-201f-4b8e-8431-b007733ec51a', '92e449ae-38bc-4d84-9a0d-f8749708db71', 'c8fbb121-4e38-4d87-8218-3538ef789dbc'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:06 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:06 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:06 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:06 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:06 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.308s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Deleted volume successfully. Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-feb210cb-0772-42cc-a8fe-0bf37117b913 tempest-VolumesTransfersTest-189889189 None] Lock "cinder-e9af88ab-a3fa-4204-9dce-7afedb9df446-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:06 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.343s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Deleted volume successfully. Jul 18 06:10:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e3675572-bdf1-4863-934b-bd47c0cdde4f tempest-ProjectReaderTests-1070281175 None] Lock "cinder-cf3ef939-c297-4d91-a358-593c3eec3b35-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Flow 'volume_create_manager' (ca5ed977-12ce-4850-a2fb-f5aa47e9ed45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02464d85-112a-4c73-9bc5-0fd4337d0cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02464d85-112a-4c73-9bc5-0fd4337d0cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1110896242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0af9fdcb553465aada8744a8caf3764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:08Z,use_quota=True,user_id='8c7df143031746cd9616d06fce37d9da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754e6838-8c30-44d1-98b7-19ba42b92fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754e6838-8c30-44d1-98b7-19ba42b92fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada00f22-a6ed-4dbb-9668-4e4c86f9a21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada00f22-a6ed-4dbb-9668-4e4c86f9a21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c', 'volume_name': 'volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496bb81b-9e77-455d-87e1-6e01bc2effef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (496bb81b-9e77-455d-87e1-6e01bc2effef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64360f19-8d0f-421b-bf8e-483c2cf6e378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Volume ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c', 'volume_size': 1} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1110896242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0af9fdcb553465aada8744a8caf3764',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:08Z,use_quota=True,user_id='8c7df143031746cd9616d06fce37d9da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Creating volume ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:08 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:08 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c 1073741824 Jul 18 06:10:08 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-bc308410-8f39-47f1-94bc-97379ff7bc0a req-ff1c09d5-3dca-4a80-82b8-2618930191e3 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:08 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c 1073741824" returned: 0 in 0.652s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:09 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c Jul 18 06:10:09 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:09 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:10:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-bc308410-8f39-47f1-94bc-97379ff7bc0a req-ff1c09d5-3dca-4a80-82b8-2618930191e3 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.781s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64360f19-8d0f-421b-bf8e-483c2cf6e378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760ef944-e305-43b1-bb94-840e8e587cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-bc308410-8f39-47f1-94bc-97379ff7bc0a req-ff1c09d5-3dca-4a80-82b8-2618930191e3 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:09 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Volume volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c (ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c): created successfully Jul 18 06:10:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760ef944-e305-43b1-bb94-840e8e587cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Flow 'volume_create_manager' (ca5ed977-12ce-4850-a2fb-f5aa47e9ed45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b3ddeb72-6358-47c1-8f79-801d2d06d1e0 tempest-VolumesTransfersTest-1682245531 None] Created volume successfully. Jul 18 06:10:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-bc308410-8f39-47f1-94bc-97379ff7bc0a req-ff1c09d5-3dca-4a80-82b8-2618930191e3 tempest-TestInstancesWithCinderVolumes-601950587 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0dfde222-e595-4c9c-b9de-20862dc1b07a', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:10:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-bc308410-8f39-47f1-94bc-97379ff7bc0a req-ff1c09d5-3dca-4a80-82b8-2618930191e3 tempest-TestInstancesWithCinderVolumes-601950587 None] attachment_update completed successfully. Jul 18 06:10:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Acquiring lock "cinder-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Lock "cinder-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Acquiring lock "cinder-quobyte-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Lock "cinder-quobyte-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:10 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71f20e7-989b-41a8-bf0d-abebaed05989]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:10 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c Jul 18 06:10:10 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:11 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c" returned: 0 in 0.443s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:11 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c Jul 18 06:10:11 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:11 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c" returned: 0 in 0.452s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Lock "cinder-quobyte-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c" released by "delete_volume" :: held 0.954s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:11 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Created reservations ['2142ff98-cd3c-48ed-a274-37a6ec4cfc31', 'add24b0a-2849-404c-bafd-843318987bd0', 'a73066e3-f09e-4370-90ae-70aa9fa77006', '2e2fa1c9-7e45-4516-8935-3140220ad204'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:11 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:11 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:12 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.619s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:12 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Deleted volume successfully. Jul 18 06:10:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-61f61b0a-ba4f-4ed7-8199-d1f62768ec54 tempest-VolumesTransfersTest-189889189 None] Lock "cinder-ce5fe8e1-e8bb-4ebc-98f5-46d66f02947c-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:21 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=77,cinder:UPDATE=84,cinder:DELETE=8,cinder:INSERT=29 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:10:22 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:DELETE=9,cinder:SELECT=81,cinder:UPDATE=100,cinder:INSERT=20 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Flow 'volume_create_manager' (dc3c4950-7553-4057-9438-00b9e2b1e632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac04ea1b-7d36-460d-a5ac-871b142b7ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac04ea1b-7d36-460d-a5ac-871b142b7ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2051779225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add6fe00-e876-4e9b-8c13-0f23ff688d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a8189ed30f4c29b32095b277ac1853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:23Z,use_quota=True,user_id='55810280faa6445db7e9214ea05f2d41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed7064d1-7011-463b-89dd-745053bf40a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed7064d1-7011-463b-89dd-745053bf40a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414438ac-c0c9-420d-b6fb-0f3a915ffa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414438ac-c0c9-420d-b6fb-0f3a915ffa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add6fe00-e876-4e9b-8c13-0f23ff688d0a', 'volume_name': 'volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1719d1eb-4769-44da-b8a4-262ba3395435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1719d1eb-4769-44da-b8a4-262ba3395435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989a2d27-a138-4f6c-8680-29bf661dbddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:23 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Volume add6fe00-e876-4e9b-8c13-0f23ff688d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a', 'volume_size': 1} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2051779225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add6fe00-e876-4e9b-8c13-0f23ff688d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a8189ed30f4c29b32095b277ac1853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:23Z,use_quota=True,user_id='55810280faa6445db7e9214ea05f2d41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Creating volume add6fe00-e876-4e9b-8c13-0f23ff688d0a {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:23 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:10:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:23 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a 1073741824 Jul 18 06:10:23 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:24 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a 1073741824" returned: 0 in 0.842s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:24 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a Jul 18 06:10:24 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:25 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a" returned: 0 in 0.468s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:10:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989a2d27-a138-4f6c-8680-29bf661dbddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63405cb-945c-4ad9-a76b-6a836a534883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Volume volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a (add6fe00-e876-4e9b-8c13-0f23ff688d0a): created successfully Jul 18 06:10:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63405cb-945c-4ad9-a76b-6a836a534883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Flow 'volume_create_manager' (dc3c4950-7553-4057-9438-00b9e2b1e632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8a29ce95-7ca2-4578-a321-e6db371fe0e3 tempest-VolumesCloneTest-1482596478 None] Created volume successfully. Jul 18 06:10:26 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Flow 'volume_create_manager' (2b02a602-e53d-42a6-a1bc-fb6d9e19d962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81506bd-6a42-4434-964e-c5dff1d7c254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81506bd-6a42-4434-964e-c5dff1d7c254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1948793702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636d357f-c06b-42b8-a3c6-75bdecb3b5bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a8189ed30f4c29b32095b277ac1853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=add6fe00-e876-4e9b-8c13-0f23ff688d0a,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:27Z,use_quota=True,user_id='55810280faa6445db7e9214ea05f2d41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de3353d-26fe-424e-99eb-d95fac95070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de3353d-26fe-424e-99eb-d95fac95070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde7f81c-e6ce-4055-811c-86d5f6f3f804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde7f81c-e6ce-4055-811c-86d5f6f3f804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '636d357f-c06b-42b8-a3c6-75bdecb3b5bf', 'volume_name': 'volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf', 'volume_size': 2, 'source_volid': 'add6fe00-e876-4e9b-8c13-0f23ff688d0a', 'source_volstatus': 'available'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b83e017-76d1-4aeb-a615-13de1edba732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b83e017-76d1-4aeb-a615-13de1edba732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1410cd-85bf-43e9-a297-98d7cc984bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:27 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Volume 636d357f-c06b-42b8-a3c6-75bdecb3b5bf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf', 'volume_size': 2, 'source_volid': 'add6fe00-e876-4e9b-8c13-0f23ff688d0a', 'source_volstatus': 'available'} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Flow 'volume_create_manager' (88f584dd-5dd2-4fd1-be5d-88d4d8b56027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34bf0bef-2b0e-4160-ac6e-0e84015d6099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:27 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Cloning volume add6fe00-e876-4e9b-8c13-0f23ff688d0a to volume 636d357f-c06b-42b8-a3c6-75bdecb3b5bf Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34bf0bef-2b0e-4160-ac6e-0e84015d6099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953673256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d7457c-e111-4981-b96f-4b5f082a72ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91ae442e89470289074debffc9e09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:27Z,use_quota=True,user_id='e790fd8fb4844f80b0056da919834952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3f2c07-1d61-44e3-8d47-1b7fa46981a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3f2c07-1d61-44e3-8d47-1b7fa46981a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11da8bc-796e-4bca-b12f-cbbc19f5273e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11da8bc-796e-4bca-b12f-cbbc19f5273e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92d7457c-e111-4981-b96f-4b5f082a72ab', 'volume_name': 'volume-92d7457c-e111-4981-b96f-4b5f082a72ab', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f72257-9079-401d-9810-7b61b8d0b0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f72257-9079-401d-9810-7b61b8d0b0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214155f4-68a8-409e-9f16-b3a28b94f3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:27 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume 92d7457c-e111-4981-b96f-4b5f082a72ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92d7457c-e111-4981-b96f-4b5f082a72ab', 'volume_size': 1} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Creating offline snapshot 3f160edc-3959-4013-bd0b-193eb4ca48f3 of volume add6fe00-e876-4e9b-8c13-0f23ff688d0a {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6c1d05-bf54-46e6-a41e-e20e51ad785d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:27 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a Jul 18 06:10:27 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:27 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a" returned: 0 in 0.597s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:27 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 1G Jul 18 06:10:27 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:28 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 1G" returned: 0 in 0.543s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:28 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 Jul 18 06:10:28 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:28 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3" returned: 0 in 0.525s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:28 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 is being set with open permissions: ugo+rw Jul 18 06:10:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:28 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 Jul 18 06:10:28 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:29 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3" returned: 0 in 0.372s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:29 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.info Jul 18 06:10:29 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:29 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.info" returned: 0 in 0.533s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:29 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.info is being set with open permissions: ugo+rw Jul 18 06:10:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:29 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.info Jul 18 06:10:29 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:30 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.info" returned: 0 in 0.283s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Acquiring lock "cinder-quobyte-636d357f-c06b-42b8-a3c6-75bdecb3b5bf" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Lock "cinder-quobyte-636d357f-c06b-42b8-a3c6-75bdecb3b5bf" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] snapshot: 3f160edc-3959-4013-bd0b-193eb4ca48f3, volume: 636d357f-c06b-42b8-a3c6-75bdecb3b5bf, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[740fbcd3-5927-473e-9e0e-ce99692081f7]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:30 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 Jul 18 06:10:30 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:30 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3" returned: 0 in 0.456s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9658167-9228-4e5b-b3d2-6b5e9965ce20]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:30 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a Jul 18 06:10:30 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:31 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a" returned: 0 in 0.472s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:31 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Path /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 06:10:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:31 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf Jul 18 06:10:31 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:10:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:35 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:35 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:35 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.685s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:10:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:10:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:10:36 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf" returned: 0 in 5.448s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:36 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c885e72-83ca-4bc4-bea0-8a3270471d8f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:36 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a Jul 18 06:10:36 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:37 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a" returned: 0 in 0.730s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:37 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:10:37 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Converted 1024.00 MB image at 187.83 MB/s Jul 18 06:10:37 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf is being set with open permissions: ugo+rw Jul 18 06:10:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:37 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf Jul 18 06:10:37 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:37 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf" returned: 0 in 0.294s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Lock "cinder-quobyte-636d357f-c06b-42b8-a3c6-75bdecb3b5bf" released by "_copy_volume_from_snapshot" :: held 7.535s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Acquiring lock "cinder-quobyte-3f160edc-3959-4013-bd0b-193eb4ca48f3" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Lock "cinder-quobyte-3f160edc-3959-4013-bd0b-193eb4ca48f3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Deleting offline snapshot 3f160edc-3959-4013-bd0b-193eb4ca48f3 of volume add6fe00-e876-4e9b-8c13-0f23ff688d0a {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:10:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] snapshot_file for this snap is: volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:10:37 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e846e99-4880-4227-b157-86e7a6e2a628]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:37 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 Jul 18 06:10:37 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:38 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3" returned: 0 in 0.385s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:38 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:10:38 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab745b97-ad69-42a0-a51d-0a10254af1ed]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:38 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a Jul 18 06:10:38 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:38 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:38 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 Jul 18 06:10:38 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:38 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3" returned: 0 in 0.381s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:39 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3 Jul 18 06:10:39 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:39 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a.3f160edc-3959-4013-bd0b-193eb4ca48f3" returned: 0 in 0.296s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Lock "cinder-quobyte-3f160edc-3959-4013-bd0b-193eb4ca48f3" released by "_delete_snapshot" :: held 1.564s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.300s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.220s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953673256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d7457c-e111-4981-b96f-4b5f082a72ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91ae442e89470289074debffc9e09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:27Z,use_quota=True,user_id='e790fd8fb4844f80b0056da919834952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Creating volume 92d7457c-e111-4981-b96f-4b5f082a72ab {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:39 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-92d7457c-e111-4981-b96f-4b5f082a72ab 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:39 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-92d7457c-e111-4981-b96f-4b5f082a72ab 1073741824 Jul 18 06:10:39 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1410cd-85bf-43e9-a297-98d7cc984bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf', 'volume_size': 2, 'source_volid': 'add6fe00-e876-4e9b-8c13-0f23ff688d0a', 'source_volstatus': 'available'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad82fa05-dcdc-4450-a288-e3d474b8e56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:39 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Volume volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf (636d357f-c06b-42b8-a3c6-75bdecb3b5bf): created successfully Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad82fa05-dcdc-4450-a288-e3d474b8e56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:39 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Flow 'volume_create_manager' (2b02a602-e53d-42a6-a1bc-fb6d9e19d962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b5f9689c-bace-44fe-a747-b66b66ce99dc tempest-VolumesCloneTest-1482596478 None] Created volume successfully. Jul 18 06:10:40 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-92d7457c-e111-4981-b96f-4b5f082a72ab 1073741824" returned: 0 in 0.654s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-92d7457c-e111-4981-b96f-4b5f082a72ab {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Acquiring lock "cinder-636d357f-c06b-42b8-a3c6-75bdecb3b5bf-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:40 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-92d7457c-e111-4981-b96f-4b5f082a72ab Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Lock "cinder-636d357f-c06b-42b8-a3c6-75bdecb3b5bf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:40 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Acquiring lock "cinder-quobyte-636d357f-c06b-42b8-a3c6-75bdecb3b5bf" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Lock "cinder-quobyte-636d357f-c06b-42b8-a3c6-75bdecb3b5bf" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd24130-cb7f-495c-9868-da88835ac84d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:40 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf Jul 18 06:10:40 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:40 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-92d7457c-e111-4981-b96f-4b5f082a72ab" returned: 0 in 0.382s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (214155f4-68a8-409e-9f16-b3a28b94f3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d7457c-e111-4981-b96f-4b5f082a72ab', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122e71e9-a27f-4d55-87e2-c7b89d99232e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume volume-92d7457c-e111-4981-b96f-4b5f082a72ab (92d7457c-e111-4981-b96f-4b5f082a72ab): created successfully Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122e71e9-a27f-4d55-87e2-c7b89d99232e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Flow 'volume_create_manager' (88f584dd-5dd2-4fd1-be5d-88d4d8b56027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7388206a-d66c-4a59-a4c4-3ba9c1c344d0 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Created volume successfully. Jul 18 06:10:40 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf" returned: 0 in 0.543s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:40 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf Jul 18 06:10:40 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:41 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-636d357f-c06b-42b8-a3c6-75bdecb3b5bf" returned: 0 in 0.316s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Lock "cinder-quobyte-636d357f-c06b-42b8-a3c6-75bdecb3b5bf" released by "delete_volume" :: held 0.930s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Created reservations ['6f306a01-28c4-4e78-b591-d93fd7466312', '61e43b04-250b-4440-8809-e667df9d4909', '703a8d84-a52b-473c-8478-b9e9ac688394', 'afeb6fb8-a4ab-47af-86b2-2c6efa81e724'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:41 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:41 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Acquiring lock "cinder-add6fe00-e876-4e9b-8c13-0f23ff688d0a-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Lock "cinder-add6fe00-e876-4e9b-8c13-0f23ff688d0a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Acquiring lock "cinder-quobyte-add6fe00-e876-4e9b-8c13-0f23ff688d0a" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Lock "cinder-quobyte-add6fe00-e876-4e9b-8c13-0f23ff688d0a" acquired by "delete_volume" :: waited 0.039s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:41 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.464s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Deleted volume successfully. Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[862ec440-d113-4bdb-ae1e-99039620e376]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-bad0bc58-df38-4fd0-9f2a-01f0fb306441 tempest-VolumesCloneTest-1482596478 None] Lock "cinder-636d357f-c06b-42b8-a3c6-75bdecb3b5bf-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Flow 'volume_create_manager' (2ce4a4df-bc01-4aa6-82f0-c4645cbe5878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa8ce84-1147-4cc3-a206-91ae0770c9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa8ce84-1147-4cc3-a206-91ae0770c9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562301148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b7e16a-d87c-480f-8cac-a329e022fede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91ae442e89470289074debffc9e09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:42Z,use_quota=True,user_id='e790fd8fb4844f80b0056da919834952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb0608e-8842-4342-838b-d2e12901db2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:41 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a Jul 18 06:10:41 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb0608e-8842-4342-838b-d2e12901db2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3421802f-3353-4ab8-8141-42fb0b4b4f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3421802f-3353-4ab8-8141-42fb0b4b4f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b7e16a-d87c-480f-8cac-a329e022fede', 'volume_name': 'volume-c2b7e16a-d87c-480f-8cac-a329e022fede', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c81748-6048-4a9a-b4f9-5d78e512b364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c81748-6048-4a9a-b4f9-5d78e512b364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383367c8-cada-46ab-9d66-53d2e2877214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:42 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume c2b7e16a-d87c-480f-8cac-a329e022fede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b7e16a-d87c-480f-8cac-a329e022fede', 'volume_size': 1} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562301148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b7e16a-d87c-480f-8cac-a329e022fede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91ae442e89470289074debffc9e09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:42Z,use_quota=True,user_id='e790fd8fb4844f80b0056da919834952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Creating volume c2b7e16a-d87c-480f-8cac-a329e022fede {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:42 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c2b7e16a-d87c-480f-8cac-a329e022fede 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:42 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c2b7e16a-d87c-480f-8cac-a329e022fede 1073741824 Jul 18 06:10:42 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-33589180-65d5-4725-940d-dc6e76a58617 req-f918e0e0-3ad7-4233-a44b-05ef188336f7 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:42 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a" returned: 0 in 0.571s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:42 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a Jul 18 06:10:42 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Flow 'volume_create_manager' (322afdee-f55b-4ab0-810d-8e0dea50b5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c55bfa4-7216-459b-a176-459f3d80d99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c55bfa4-7216-459b-a176-459f3d80d99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1707074570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c908679-ab4a-4c05-8e10-13e330de5140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91ae442e89470289074debffc9e09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:42Z,use_quota=True,user_id='e790fd8fb4844f80b0056da919834952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb99dbf4-0398-447f-8097-8767ac18466d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb99dbf4-0398-447f-8097-8767ac18466d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce971a66-5b29-476f-b73d-343ad37afab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce971a66-5b29-476f-b73d-343ad37afab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c908679-ab4a-4c05-8e10-13e330de5140', 'volume_name': 'volume-0c908679-ab4a-4c05-8e10-13e330de5140', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda537e0-3a82-4376-9c2b-3e104ec53cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda537e0-3a82-4376-9c2b-3e104ec53cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b8f205-cd80-4ba6-a8bb-d756a07d1156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:42 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume 0c908679-ab4a-4c05-8e10-13e330de5140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c908679-ab4a-4c05-8e10-13e330de5140', 'volume_size': 1} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:42 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-add6fe00-e876-4e9b-8c13-0f23ff688d0a" returned: 0 in 0.366s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Lock "cinder-quobyte-add6fe00-e876-4e9b-8c13-0f23ff688d0a" released by "delete_volume" :: held 1.062s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Created reservations ['ef1c6f3a-bde0-4108-9383-295c13022a18', 'f1b46b99-5fcb-42e7-b9ec-7a73ebc6a05d', '1634111d-c412-421c-9e92-a198f138fe32', '389368d3-cdb5-4245-84c4-4ae9e7494186'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:42 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c2b7e16a-d87c-480f-8cac-a329e022fede 1073741824" returned: 0 in 0.863s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c2b7e16a-d87c-480f-8cac-a329e022fede {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:43 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c2b7e16a-d87c-480f-8cac-a329e022fede Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:43 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Flow 'volume_create_manager' (bcb609d0-1ee5-43d3-bcfa-dc7be551b42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2301807d-3174-43e1-a625-44bae7eec67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2301807d-3174-43e1-a625-44bae7eec67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369113426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91ae442e89470289074debffc9e09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:43Z,use_quota=True,user_id='e790fd8fb4844f80b0056da919834952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c46ea6-8a5c-451b-b5df-6b06ebf382f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c46ea6-8a5c-451b-b5df-6b06ebf382f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76166157-b3d4-4a1d-a97d-06534eb5b8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:43 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:43 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76166157-b3d4-4a1d-a97d-06534eb5b8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e', 'volume_name': 'volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a21982-d549-4e75-a4b4-96738fce3d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a21982-d549-4e75-a4b4-96738fce3d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405af7e8-49e8-4cbb-a3e5-ddca70ffab88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume 56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e', 'volume_size': 1} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:43 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c2b7e16a-d87c-480f-8cac-a329e022fede" returned: 0 in 0.325s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-33589180-65d5-4725-940d-dc6e76a58617 req-f918e0e0-3ad7-4233-a44b-05ef188336f7 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.170s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-33589180-65d5-4725-940d-dc6e76a58617 req-f918e0e0-3ad7-4233-a44b-05ef188336f7 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383367c8-cada-46ab-9d66-53d2e2877214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b7e16a-d87c-480f-8cac-a329e022fede', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d90b5cc-e4df-4990-8d0f-2714c3dec5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1707074570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c908679-ab4a-4c05-8e10-13e330de5140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91ae442e89470289074debffc9e09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:42Z,use_quota=True,user_id='e790fd8fb4844f80b0056da919834952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Creating volume 0c908679-ab4a-4c05-8e10-13e330de5140 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:43 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:10:43 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0c908679-ab4a-4c05-8e10-13e330de5140 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.427s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume volume-c2b7e16a-d87c-480f-8cac-a329e022fede (c2b7e16a-d87c-480f-8cac-a329e022fede): created successfully Jul 18 06:10:43 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0c908679-ab4a-4c05-8e10-13e330de5140 1073741824 Jul 18 06:10:43 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d90b5cc-e4df-4990-8d0f-2714c3dec5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Flow 'volume_create_manager' (2ce4a4df-bc01-4aa6-82f0-c4645cbe5878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Deleted volume successfully. Jul 18 06:10:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-093b75ed-67af-4074-a639-543d41e9b239 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Created volume successfully. Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7291400c-636c-43a2-8baa-913582975850 tempest-VolumesCloneTest-1482596478 None] Lock "cinder-add6fe00-e876-4e9b-8c13-0f23ff688d0a-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-33589180-65d5-4725-940d-dc6e76a58617 req-f918e0e0-3ad7-4233-a44b-05ef188336f7 tempest-TestInstancesWithCinderVolumes-601950587 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-ec8ce524-5db9-491a-8348-b859e10a3a21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65dee3c9-4f55-484d-85be-29a4f587a4a0', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Flow 'volume_create_manager' (55be7cd3-8d3b-494f-b6b7-149857cc1191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca77edb-b225-4f40-b593-fa0b3c911167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-33589180-65d5-4725-940d-dc6e76a58617 req-f918e0e0-3ad7-4233-a44b-05ef188336f7 tempest-TestInstancesWithCinderVolumes-601950587 None] attachment_update completed successfully. Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca77edb-b225-4f40-b593-fa0b3c911167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1792402441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3feec9-473f-4574-abae-ea5597812ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91ae442e89470289074debffc9e09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:44Z,use_quota=True,user_id='e790fd8fb4844f80b0056da919834952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04391595-dc56-4350-9fd7-b6f0afedd028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04391595-dc56-4350-9fd7-b6f0afedd028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2258a3-c546-4cee-8e5e-2b0c27740821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2258a3-c546-4cee-8e5e-2b0c27740821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc3feec9-473f-4574-abae-ea5597812ce3', 'volume_name': 'volume-fc3feec9-473f-4574-abae-ea5597812ce3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6398f5c-5eff-432d-97d4-50a2aa433dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6398f5c-5eff-432d-97d4-50a2aa433dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10aec6e5-bb96-4260-9df7-6c5f644db8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:44 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume fc3feec9-473f-4574-abae-ea5597812ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc3feec9-473f-4574-abae-ea5597812ce3', 'volume_size': 1} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Flow 'volume_create_manager' (0921d5cc-9ab9-49b6-8ecc-6d5768b9e878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:44 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b307f2d4-18a6-420a-a6f5-0ea0f4cf040c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0c908679-ab4a-4c05-8e10-13e330de5140 1073741824" returned: 0 in 0.894s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b307f2d4-18a6-420a-a6f5-0ea0f4cf040c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2019864348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb05c07-ba7e-458d-aa3a-8988dc949f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91ae442e89470289074debffc9e09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:44Z,use_quota=True,user_id='e790fd8fb4844f80b0056da919834952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc30c136-550c-4c5d-be4f-957bbf99955d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc30c136-550c-4c5d-be4f-957bbf99955d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65b0029-df1e-46bd-8fc1-54d981a53e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65b0029-df1e-46bd-8fc1-54d981a53e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb05c07-ba7e-458d-aa3a-8988dc949f00', 'volume_name': 'volume-efb05c07-ba7e-458d-aa3a-8988dc949f00', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c1d10e-ceda-49ce-a0da-8f1f2ff3a53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c1d10e-ceda-49ce-a0da-8f1f2ff3a53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec15bd0a-da85-43c9-b45c-8ebe69f59aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:44 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume efb05c07-ba7e-458d-aa3a-8988dc949f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb05c07-ba7e-458d-aa3a-8988dc949f00', 'volume_size': 1} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0c908679-ab4a-4c05-8e10-13e330de5140 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:44 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0c908679-ab4a-4c05-8e10-13e330de5140 Jul 18 06:10:44 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:44 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0c908679-ab4a-4c05-8e10-13e330de5140" returned: 0 in 0.397s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.765s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-369113426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91ae442e89470289074debffc9e09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:43Z,use_quota=True,user_id='e790fd8fb4844f80b0056da919834952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Creating volume 56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:44 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b8f205-cd80-4ba6-a8bb-d756a07d1156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c908679-ab4a-4c05-8e10-13e330de5140', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d5c359-d94e-41cd-a19b-8591175ecf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:44 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e 1073741824 Jul 18 06:10:44 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:45 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume volume-0c908679-ab4a-4c05-8e10-13e330de5140 (0c908679-ab4a-4c05-8e10-13e330de5140): created successfully Jul 18 06:10:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d5c359-d94e-41cd-a19b-8591175ecf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:45 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Flow 'volume_create_manager' (322afdee-f55b-4ab0-810d-8e0dea50b5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:45 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d6457c0a-c646-4ede-8ca9-72ad6c61c793 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Created volume successfully. Jul 18 06:10:45 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e 1073741824" returned: 0 in 0.769s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:45 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e Jul 18 06:10:45 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:46 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e" returned: 0 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1792402441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3feec9-473f-4574-abae-ea5597812ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91ae442e89470289074debffc9e09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:44Z,use_quota=True,user_id='e790fd8fb4844f80b0056da919834952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Creating volume fc3feec9-473f-4574-abae-ea5597812ce3 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:46 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fc3feec9-473f-4574-abae-ea5597812ce3 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405af7e8-49e8-4cbb-a3e5-ddca70ffab88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a34ab6b-250a-4ec1-95fa-8517102ad5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:46 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fc3feec9-473f-4574-abae-ea5597812ce3 1073741824 Jul 18 06:10:46 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:46 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e (56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e): created successfully Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a34ab6b-250a-4ec1-95fa-8517102ad5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Flow 'volume_create_manager' (bcb609d0-1ee5-43d3-bcfa-dc7be551b42d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-289a6b4e-cad7-4845-b614-aef8c96934b9 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Created volume successfully. Jul 18 06:10:46 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fc3feec9-473f-4574-abae-ea5597812ce3 1073741824" returned: 0 in 0.802s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fc3feec9-473f-4574-abae-ea5597812ce3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:47 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fc3feec9-473f-4574-abae-ea5597812ce3 Jul 18 06:10:47 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:47 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fc3feec9-473f-4574-abae-ea5597812ce3" returned: 0 in 0.355s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.929s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2019864348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb05c07-ba7e-458d-aa3a-8988dc949f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db91ae442e89470289074debffc9e09e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:44Z,use_quota=True,user_id='e790fd8fb4844f80b0056da919834952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Creating volume efb05c07-ba7e-458d-aa3a-8988dc949f00 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:47 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-efb05c07-ba7e-458d-aa3a-8988dc949f00 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:47 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-efb05c07-ba7e-458d-aa3a-8988dc949f00 1073741824 Jul 18 06:10:47 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10aec6e5-bb96-4260-9df7-6c5f644db8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3feec9-473f-4574-abae-ea5597812ce3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb88c241-948d-47c4-9eaf-abf5670cfdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-44b8f8c7-6fdb-4d41-8c59-e8a151b56267 req-aefe8352-85d8-4af4-a95b-2f6127a7e4a0 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:47 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume volume-fc3feec9-473f-4574-abae-ea5597812ce3 (fc3feec9-473f-4574-abae-ea5597812ce3): created successfully Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb88c241-948d-47c4-9eaf-abf5670cfdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Flow 'volume_create_manager' (55be7cd3-8d3b-494f-b6b7-149857cc1191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-021bf96e-1fbb-49a1-b9ec-7e3569593cb3 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Created volume successfully. Jul 18 06:10:48 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-efb05c07-ba7e-458d-aa3a-8988dc949f00 1073741824" returned: 0 in 0.707s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-efb05c07-ba7e-458d-aa3a-8988dc949f00 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:48 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-efb05c07-ba7e-458d-aa3a-8988dc949f00 Jul 18 06:10:48 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:48 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-efb05c07-ba7e-458d-aa3a-8988dc949f00" returned: 0 in 0.437s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:10:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-44b8f8c7-6fdb-4d41-8c59-e8a151b56267 req-aefe8352-85d8-4af4-a95b-2f6127a7e4a0 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.071s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec15bd0a-da85-43c9-b45c-8ebe69f59aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb05c07-ba7e-458d-aa3a-8988dc949f00', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd032fac-ecc1-467c-88b4-a61664f57ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-44b8f8c7-6fdb-4d41-8c59-e8a151b56267 req-aefe8352-85d8-4af4-a95b-2f6127a7e4a0 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:48 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Volume volume-efb05c07-ba7e-458d-aa3a-8988dc949f00 (efb05c07-ba7e-458d-aa3a-8988dc949f00): created successfully Jul 18 06:10:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd032fac-ecc1-467c-88b4-a61664f57ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Flow 'volume_create_manager' (0921d5cc-9ab9-49b6-8ecc-6d5768b9e878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-bcb14e1d-5455-4ad4-a8d3-8c2553a9293c tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Created volume successfully. Jul 18 06:10:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-44b8f8c7-6fdb-4d41-8c59-e8a151b56267 req-aefe8352-85d8-4af4-a95b-2f6127a7e4a0 tempest-TestInstancesWithCinderVolumes-601950587 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c4cfb6f-d61d-437c-9835-5d0c1fa97cc1', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:10:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-44b8f8c7-6fdb-4d41-8c59-e8a151b56267 req-aefe8352-85d8-4af4-a95b-2f6127a7e4a0 tempest-TestInstancesWithCinderVolumes-601950587 None] attachment_update completed successfully. Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "cinder-efb05c07-ba7e-458d-aa3a-8988dc949f00-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-efb05c07-ba7e-458d-aa3a-8988dc949f00-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "cinder-quobyte-efb05c07-ba7e-458d-aa3a-8988dc949f00" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-quobyte-efb05c07-ba7e-458d-aa3a-8988dc949f00" acquired by "delete_volume" :: waited 0.048s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb17cba-8b70-440f-95ee-b40bedb8e451]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-efb05c07-ba7e-458d-aa3a-8988dc949f00 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Flow 'volume_create_manager' (58cbe226-ca91-4ba6-92b5-0d7dc2995dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2aee16b-839f-436a-87ce-c3d2f26f781d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:49 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-efb05c07-ba7e-458d-aa3a-8988dc949f00 Jul 18 06:10:49 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2aee16b-839f-436a-87ce-c3d2f26f781d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-246312128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54850c60-d15d-4d5c-84e0-538ff91456f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19b76ce8b9d4127a5c7016fb1acabd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:49Z,use_quota=True,user_id='c862ded3a49a40c2ab60e516b1753d20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4beb7f0f-3990-43f1-9c12-f748120d8d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4beb7f0f-3990-43f1-9c12-f748120d8d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a75423-7773-4d84-b970-c7ee027c399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 06:10:49 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-efb05c07-ba7e-458d-aa3a-8988dc949f00" returned: 0 in 0.559s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-efb05c07-ba7e-458d-aa3a-8988dc949f00 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a75423-7773-4d84-b970-c7ee027c399d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54850c60-d15d-4d5c-84e0-538ff91456f8', 'volume_name': 'volume-54850c60-d15d-4d5c-84e0-538ff91456f8', 'volume_size': 1, 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56cf243eadf74e53add363d5f7382182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'created_at': datetime.datetime(2026, 7, 18, 3, 51, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 51, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f78052-6e07-4146-a715-a847a28a3539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:50 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-efb05c07-ba7e-458d-aa3a-8988dc949f00 Jul 18 06:10:50 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f78052-6e07-4146-a715-a847a28a3539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede709ee-3a32-4d0d-8d92-92df24802c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Volume 54850c60-d15d-4d5c-84e0-538ff91456f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54850c60-d15d-4d5c-84e0-538ff91456f8', 'volume_size': 1, 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56cf243eadf74e53add363d5f7382182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'created_at': datetime.datetime(2026, 7, 18, 3, 51, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 51, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Trying to clone 54850c60-d15d-4d5c-84e0-538ff91456f8 from image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 06:10:50 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Image download 20.69 MB at 20.69 MB/s Jul 18 06:10:50 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-efb05c07-ba7e-458d-aa3a-8988dc949f00" returned: 0 in 0.476s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-quobyte-efb05c07-ba7e-458d-aa3a-8988dc949f00" released by "delete_volume" :: held 1.143s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dd8997-26c1-4a80-a623-dd18063259fa]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Created reservations ['ecc7b128-2f29-45e6-87e7-98dae95ab32d', 'd42a7ff8-ae23-4d02-be53-9cdaf3780641', '6085dae6-c126-474c-9237-bb8583966f80', '12966f7b-09be-49d4-8961-550290d066a2'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:50 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD Jul 18 06:10:50 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:50 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:50 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:50 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:50 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Temporary image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a is fetched for user c862ded3a49a40c2ab60e516b1753d20. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 06:10:51 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Deleted volume successfully. Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24e3027-2696-4583-9729-7bb5f44ad1aa]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-74ccad8b-b9da-42b3-bfe3-39cd4083588a tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-efb05c07-ba7e-458d-aa3a-8988dc949f00-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:51 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD Jul 18 06:10:51 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:51 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-246312128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54850c60-d15d-4d5c-84e0-538ff91456f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19b76ce8b9d4127a5c7016fb1acabd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:49Z,use_quota=True,user_id='c862ded3a49a40c2ab60e516b1753d20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Creating volume 54850c60-d15d-4d5c-84e0-538ff91456f8 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:51 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:51 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 1073741824 Jul 18 06:10:51 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "cinder-fc3feec9-473f-4574-abae-ea5597812ce3-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-fc3feec9-473f-4574-abae-ea5597812ce3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "cinder-quobyte-fc3feec9-473f-4574-abae-ea5597812ce3" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Flow 'volume_create_manager' (4b3465dc-d0a2-4849-b8be-e1c901ab32cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5294e73e-2499-4382-a92e-c91a8722248b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-quobyte-fc3feec9-473f-4574-abae-ea5597812ce3" acquired by "delete_volume" :: waited 0.055s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c850ac6-f1b5-4863-a7e6-07275e0fba41]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fc3feec9-473f-4574-abae-ea5597812ce3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5294e73e-2499-4382-a92e-c91a8722248b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2130721832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79aa18859139493cbd60d4879251d000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:52Z,use_quota=True,user_id='7eadde69cfcd4049a0bb214fc519dab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ebfe22-c968-4305-b8ff-c230cb0f0332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ebfe22-c968-4305-b8ff-c230cb0f0332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f33c398-be86-42fd-9693-3533c4a7d30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f33c398-be86-42fd-9693-3533c4a7d30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5945a09-ced0-4a3c-a9f8-bb6f2c50eab6', 'volume_name': 'volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c160640-d699-4cc0-bb60-34e1b70d226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c160640-d699-4cc0-bb60-34e1b70d226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00ce6b5c-d369-4a97-b0ba-11c70381c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:51 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Volume d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6', 'volume_size': 1} Jul 18 06:10:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:52 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 1073741824" returned: 0 in 0.560s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:52 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fc3feec9-473f-4574-abae-ea5597812ce3 Jul 18 06:10:52 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:52 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 Jul 18 06:10:52 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:52 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fc3feec9-473f-4574-abae-ea5597812ce3" returned: 0 in 0.395s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fc3feec9-473f-4574-abae-ea5597812ce3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:52 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8" returned: 0 in 0.264s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2130721832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79aa18859139493cbd60d4879251d000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:52Z,use_quota=True,user_id='7eadde69cfcd4049a0bb214fc519dab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Creating volume d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:52 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fc3feec9-473f-4574-abae-ea5597812ce3 Jul 18 06:10:52 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:52 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:52 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 1073741824 Jul 18 06:10:52 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Attempting download of b5dcfdae-2c52-436e-9a7d-1ba63c90db8a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}])) to volume 54850c60-d15d-4d5c-84e0-538ff91456f8. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3287fa-f619-4979-843f-308ef3fb822f]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_dr75y0d2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:52 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fc3feec9-473f-4574-abae-ea5597812ce3" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-quobyte-fc3feec9-473f-4574-abae-ea5597812ce3" released by "delete_volume" :: held 0.710s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:52 devstack sudo[102515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_dr75y0d2 Jul 18 06:10:52 devstack sudo[102515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Created reservations ['5ebf73bf-0bda-4756-9794-152b98452286', '4dbb8a64-68a9-4f89-b835-70dad20ffb58', 'be97264a-1764-482d-8e43-8c1e97d35341', '2f255a4e-2bda-4b52-80a5-6d3529c194ff'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:52 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:52 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:52 devstack sudo[102515]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_dr75y0d2" returned: 0 in 0.421s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_dr75y0d2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "cinder-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:53 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 1073741824" returned: 0 in 0.730s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:53 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_dr75y0d2 Jul 18 06:10:53 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "cinder-quobyte-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-quobyte-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:53 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bc3966-eb30-4cec-bd83-8a596ec322a0]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:53 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 Jul 18 06:10:53 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Deleted volume successfully. Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b4c672d6-6fb1-4ee5-a038-0de5fb0fddcb tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-fc3feec9-473f-4574-abae-ea5597812ce3-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:53 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e Jul 18 06:10:53 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:53 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_dr75y0d2" returned: 1 in 0.527s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_dr75y0d2' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac89bbd-3754-41df-bd79-daf2d2576bed]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:53 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" returned: 0 in 0.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00ce6b5c-d369-4a97-b0ba-11c70381c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039462b1-0f93-4753-b4f2-269bf3b9350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Volume volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 (d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6): created successfully Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039462b1-0f93-4753-b4f2-269bf3b9350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Flow 'volume_create_manager' (4b3465dc-d0a2-4849-b8be-e1c901ab32cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:53 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD Jul 18 06:10:53 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-eb53b9cc-c716-4ef0-9872-b1cb9f219764 tempest-SnapshotDependencyTests-1265741774 None] Created volume successfully. Jul 18 06:10:53 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e" returned: 0 in 0.485s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:53 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e Jul 18 06:10:53 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:53 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] b5dcfdae-2c52-436e-9a7d-1ba63c90db8a was qcow2, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:53 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 Jul 18 06:10:53 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:53 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-quobyte-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e" released by "delete_volume" :: held 0.874s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Created reservations ['70065ba9-5d70-4088-9755-3b215b4320d3', '86d76b2a-20e2-4dd9-97df-92e97fde4d4f', '283fa09e-9429-45c7-a6e1-f65f5b9ed257', '29e69290-eac9-47f8-9a18-001d5035dd4a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] Creating offline snapshot 95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 of volume d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d91828-151f-4c11-ab1d-45c389a1fe07]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:54 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:54 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:54 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 Jul 18 06:10:54 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:54 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Deleted volume successfully. Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c24d5bc2-e91a-4781-93a2-c8fd0bf428af tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-56e7bfbf-a0b8-45fa-be4e-6d1ef5868c0e-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:54 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" returned: 0 in 0.540s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:54 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 1G Jul 18 06:10:54 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:55 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-d3eeaf39-931a-421b-8d6c-d9cd216cae09 req-1607356d-826e-46bd-9a6c-882b31ac5a6a tempest-TestInstancesWithCinderVolumes-601950587 None] Terminate volume connection completed successfully. Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-d3eeaf39-931a-421b-8d6c-d9cd216cae09 req-1607356d-826e-46bd-9a6c-882b31ac5a6a tempest-TestInstancesWithCinderVolumes-601950587 None] Deleting attachment 65dee3c9-4f55-484d-85be-29a4f587a4a0. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "cinder-0c908679-ab4a-4c05-8e10-13e330de5140-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-0c908679-ab4a-4c05-8e10-13e330de5140-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "cinder-quobyte-0c908679-ab4a-4c05-8e10-13e330de5140" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-quobyte-0c908679-ab4a-4c05-8e10-13e330de5140" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[52789a5c-7b18-4d1f-a60a-a28d8410bcff]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0c908679-ab4a-4c05-8e10-13e330de5140 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:55 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 1G" returned: 0 in 0.550s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:55 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 Jul 18 06:10:55 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:55 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0c908679-ab4a-4c05-8e10-13e330de5140 Jul 18 06:10:55 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:55 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:55 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 is being set with open permissions: ugo+rw Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:55 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "cinder-ec8ce524-5db9-491a-8348-b859e10a3a21-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:55 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 Jul 18 06:10:55 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0c908679-ab4a-4c05-8e10-13e330de5140" returned: 0 in 0.409s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0c908679-ab4a-4c05-8e10-13e330de5140 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "cinder-ec8ce524-5db9-491a-8348-b859e10a3a21-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:55 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0c908679-ab4a-4c05-8e10-13e330de5140 Jul 18 06:10:55 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "cinder-quobyte-ec8ce524-5db9-491a-8348-b859e10a3a21" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "cinder-quobyte-ec8ce524-5db9-491a-8348-b859e10a3a21" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6508f44d-3ca2-47e6-94b9-bf939be3542f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ec8ce524-5db9-491a-8348-b859e10a3a21 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:56 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8" returned: 0 in 2.329s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_494r6rrddevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:10:56 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Converted 112.00 MB image at 48.05 MB/s Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:56 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ec8ce524-5db9-491a-8348-b859e10a3a21 Jul 18 06:10:56 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:56 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 1G Jul 18 06:10:56 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:56 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6" returned: 0 in 0.397s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:56 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0c908679-ab4a-4c05-8e10-13e330de5140" returned: 0 in 0.360s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-quobyte-0c908679-ab4a-4c05-8e10-13e330de5140" released by "delete_volume" :: held 0.843s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:56 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.info Jul 18 06:10:56 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Created reservations ['68a3033b-3f04-4a4b-9ece-885b314d4a24', 'cb388e25-51e0-4d39-98a0-afbc99899aef', '151bdbd0-f439-4a8c-9348-a84fb416cc4b', '2661f741-b3b4-4c92-aa53-ac76f796742c'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:56 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ec8ce524-5db9-491a-8348-b859e10a3a21" returned: 0 in 0.531s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ec8ce524-5db9-491a-8348-b859e10a3a21 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:56 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ec8ce524-5db9-491a-8348-b859e10a3a21 Jul 18 06:10:56 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:56 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 1G" returned: 0 in 0.487s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Downloaded image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}])) to volume 54850c60-d15d-4d5c-84e0-538ff91456f8 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Temporary image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a for user c862ded3a49a40c2ab60e516b1753d20 is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Marking volume 54850c60-d15d-4d5c-84e0-538ff91456f8 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 06:10:56 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:56 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Copying metadata from image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a to 54850c60-d15d-4d5c-84e0-538ff91456f8. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Creating volume glance metadata for volume 54850c60-d15d-4d5c-84e0-538ff91456f8 backed by image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 06:10:56 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.info" returned: 0 in 0.405s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:56 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.info is being set with open permissions: ugo+rw Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:56 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.info Jul 18 06:10:56 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede709ee-3a32-4d0d-8d92-92df24802c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54850c60-d15d-4d5c-84e0-538ff91456f8', 'volume_size': 1, 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56cf243eadf74e53add363d5f7382182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'created_at': datetime.datetime(2026, 7, 18, 3, 51, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 51, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a3c13a-9d72-4e85-943a-16566c8c06dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:56 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Volume volume-54850c60-d15d-4d5c-84e0-538ff91456f8 (54850c60-d15d-4d5c-84e0-538ff91456f8): created successfully Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a3c13a-9d72-4e85-943a-16566c8c06dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Flow 'volume_create_manager' (58cbe226-ca91-4ba6-92b5-0d7dc2995dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cae4ab6a-b180-4186-b681-2b43f27a9dd1 tempest-VolumesExtendTest-1909230424 None] Created volume successfully. Jul 18 06:10:56 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ec8ce524-5db9-491a-8348-b859e10a3a21" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:56 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "cinder-quobyte-ec8ce524-5db9-491a-8348-b859e10a3a21" released by "delete_volume" :: held 0.951s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Deleted volume successfully. Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a05d5fc8-d4eb-4197-9057-4331c67c99fa tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-0c908679-ab4a-4c05-8e10-13e330de5140-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:57 devstack cinder-volume[87750]: WARNING cinder.quota [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2084905666-464029639 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2084905666-464029639, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:10:57 devstack cinder-volume[87750]: WARNING cinder.quota [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2084905666-464029639 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2084905666-464029639, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Created reservations ['34b37559-f33e-4b0e-91f7-9a345eda1207', '8bb677a9-b784-4278-a2da-67adf753f126', 'c6e19f21-c8a5-4257-838a-d10ce2c75b86', '7d1dfd5a-05e9-443c-b0fb-450f4e713edd'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:57 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.info" returned: 0 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b2b93bcf-98ce-41b9-934d-d91f63c3c58e tempest-SnapshotDependencyTests-1265741774 None] Create snapshot completed successfully Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:57 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:57 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-28535ebf-0df1-4a86-82c8-094bfe238375 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-28535ebf-0df1-4a86-82c8-094bfe238375 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[138d3934-0e14-4aed-bb14-635ed74e73b6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-28535ebf-0df1-4a86-82c8-094bfe238375 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:57 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 Jul 18 06:10:57 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:57 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.354s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Deleted volume successfully. Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21f346ff-8607-481b-ae31-7c8fb0717288 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "cinder-ec8ce524-5db9-491a-8348-b859e10a3a21-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "cinder-c2b7e16a-d87c-480f-8cac-a329e022fede-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-c2b7e16a-d87c-480f-8cac-a329e022fede-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "cinder-quobyte-c2b7e16a-d87c-480f-8cac-a329e022fede" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-quobyte-c2b7e16a-d87c-480f-8cac-a329e022fede" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:57 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-28535ebf-0df1-4a86-82c8-094bfe238375 tempest-VolumesExtendTest-1909230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8" returned: 0 in 0.508s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-28535ebf-0df1-4a86-82c8-094bfe238375 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 2G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ecc82f-ff89-43c5-a88d-25941fc4f3c0]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c2b7e16a-d87c-480f-8cac-a329e022fede {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-28535ebf-0df1-4a86-82c8-094bfe238375 tempest-VolumesExtendTest-1909230424 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 2G" returned: 0 in 0.160s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-28535ebf-0df1-4a86-82c8-094bfe238375 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.695s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:58 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c2b7e16a-d87c-480f-8cac-a329e022fede Jul 18 06:10:58 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-28535ebf-0df1-4a86-82c8-094bfe238375 tempest-VolumesExtendTest-1909230424 None] Extend volume completed successfully. Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Flow 'volume_create_manager' (7dcc866c-b6ef-4821-b2a7-be7774533946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534bea04-815e-4768-a52b-fd4c7eec9aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534bea04-815e-4768-a52b-fd4c7eec9aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1edd02-929e-483c-a459-8c21bfed4219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79aa18859139493cbd60d4879251d000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=95dcd2cb-27e1-4fa6-9169-d37e9c1508a6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:10:58Z,use_quota=True,user_id='7eadde69cfcd4049a0bb214fc519dab8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2a8c32-77e2-4acb-a44f-cddcf35c38dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2a8c32-77e2-4acb-a44f-cddcf35c38dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1def0d-ffc3-4b54-9d2c-adeba73eaa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1def0d-ffc3-4b54-9d2c-adeba73eaa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd1edd02-929e-483c-a459-8c21bfed4219', 'volume_name': 'volume-cd1edd02-929e-483c-a459-8c21bfed4219', 'volume_size': 1, 'snapshot_id': '95dcd2cb-27e1-4fa6-9169-d37e9c1508a6'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effa2638-f42f-4878-b2e4-a3c978004ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (effa2638-f42f-4878-b2e4-a3c978004ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd69d619-e303-4b32-8009-0515cdb82c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:10:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Volume cd1edd02-929e-483c-a459-8c21bfed4219: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd1edd02-929e-483c-a459-8c21bfed4219', 'volume_size': 1, 'snapshot_id': '95dcd2cb-27e1-4fa6-9169-d37e9c1508a6'} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "cinder-quobyte-95dcd2cb-27e1-4fa6-9169-d37e9c1508a6-cd1edd02-929e-483c-a459-8c21bfed4219" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-quobyte-95dcd2cb-27e1-4fa6-9169-d37e9c1508a6-cd1edd02-929e-483c-a459-8c21bfed4219" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Creating volume cd1edd02-929e-483c-a459-8c21bfed4219 from snapshot 95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "cinder-quobyte-cd1edd02-929e-483c-a459-8c21bfed4219" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:58 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c2b7e16a-d87c-480f-8cac-a329e022fede" returned: 0 in 0.557s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c2b7e16a-d87c-480f-8cac-a329e022fede {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-quobyte-cd1edd02-929e-483c-a459-8c21bfed4219" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] snapshot: 95dcd2cb-27e1-4fa6-9169-d37e9c1508a6, volume: cd1edd02-929e-483c-a459-8c21bfed4219, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 06:10:58 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c2b7e16a-d87c-480f-8cac-a329e022fede Jul 18 06:10:58 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a73e40-8ea5-49b7-b66d-8296bcf10c6f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "cinder-54850c60-d15d-4d5c-84e0-538ff91456f8-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:58 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 Jul 18 06:10:58 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-54850c60-d15d-4d5c-84e0-538ff91456f8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:58 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "cinder-quobyte-54850c60-d15d-4d5c-84e0-538ff91456f8" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c2b7e16a-d87c-480f-8cac-a329e022fede" returned: 0 in 0.313s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-quobyte-c2b7e16a-d87c-480f-8cac-a329e022fede" released by "delete_volume" :: held 0.953s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-quobyte-54850c60-d15d-4d5c-84e0-538ff91456f8" acquired by "delete_volume" :: waited 0.046s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81fdf7e-23af-4c03-ae8f-b88ee51fc2ea]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Created reservations ['21d15619-5cbf-4322-893a-d1dec6fdebd2', '651e9083-8dac-4862-a329-89872bb0f073', '735373d1-6d6f-433c-9828-49379711648a', '4b28fa58-3b94-4b8a-b628-aad81caa1ccd'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:58 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 Jul 18 06:10:58 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:59 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:59 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:59 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6" returned: 0 in 0.499s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c51bb4e-bd5a-45ef-b231-6b1df58cceab]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:59 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 Jul 18 06:10:59 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:59 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8" returned: 0 in 0.459s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:59 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8 Jul 18 06:10:59 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:59 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:10:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Deleted volume successfully. Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8dfef831-2a8c-4d7c-8b65-1580f680b314 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-c2b7e16a-d87c-480f-8cac-a329e022fede-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:59 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" returned: 0 in 0.448s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Path /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:59 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219 Jul 18 06:10:59 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:59 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-54850c60-d15d-4d5c-84e0-538ff91456f8" returned: 0 in 0.332s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-quobyte-54850c60-d15d-4d5c-84e0-538ff91456f8" released by "delete_volume" :: held 0.842s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Created reservations ['5ed8f82f-e76f-41c1-9677-5bbc56408d84', '1d687772-959d-4e20-a8fc-49673a229c21', 'efdaeac1-f666-4772-b1f8-06eea53327de', '251121f6-6281-4ca0-9c58-69e3fb04a84a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:10:59 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:10:59 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:10:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "cinder-92d7457c-e111-4981-b96f-4b5f082a72ab-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-92d7457c-e111-4981-b96f-4b5f082a72ab-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "cinder-quobyte-92d7457c-e111-4981-b96f-4b5f082a72ab" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-quobyte-92d7457c-e111-4981-b96f-4b5f082a72ab" acquired by "delete_volume" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:00 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.383s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:00 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Deleted volume successfully. Jul 18 06:11:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b0d23c-eedf-45af-bac0-6fd4e4c26c21]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-92d7457c-e111-4981-b96f-4b5f082a72ab {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cd4b4bba-4aa4-4739-878f-f8c78664f602 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-54850c60-d15d-4d5c-84e0-538ff91456f8-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:00 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-92d7457c-e111-4981-b96f-4b5f082a72ab Jul 18 06:11:00 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-68ff0da3-31c5-4d76-b807-a2686acf8cdf req-bf0729d8-b884-4b67-af80-282a2af5d018 tempest-TestInstancesWithCinderVolumes-601950587 None] Terminate volume connection completed successfully. Jul 18 06:11:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-68ff0da3-31c5-4d76-b807-a2686acf8cdf req-bf0729d8-b884-4b67-af80-282a2af5d018 tempest-TestInstancesWithCinderVolumes-601950587 None] Deleting attachment 6c4cfb6f-d61d-437c-9835-5d0c1fa97cc1. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:11:00 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-92d7457c-e111-4981-b96f-4b5f082a72ab" returned: 0 in 0.823s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-92d7457c-e111-4981-b96f-4b5f082a72ab {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Flow 'volume_create_manager' (63741515-ed85-43ac-9e41-b72fa3b4058e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:01 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-92d7457c-e111-4981-b96f-4b5f082a72ab Jul 18 06:11:01 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27e156e-510c-48e8-a8e6-fad4abf8f9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27e156e-510c-48e8-a8e6-fad4abf8f9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-976995874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0557bc16-149e-4cb7-ad53-a05410f0d946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19b76ce8b9d4127a5c7016fb1acabd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:01Z,use_quota=True,user_id='c862ded3a49a40c2ab60e516b1753d20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67da98bc-a1ce-421a-a86d-1cf3ad443695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67da98bc-a1ce-421a-a86d-1cf3ad443695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4057aa0-cfa5-4f43-b7a6-3a7354ecb9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4057aa0-cfa5-4f43-b7a6-3a7354ecb9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0557bc16-149e-4cb7-ad53-a05410f0d946', 'volume_name': 'volume-0557bc16-149e-4cb7-ad53-a05410f0d946', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba130ab8-f6fa-43aa-af61-51ebe75ca313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba130ab8-f6fa-43aa-af61-51ebe75ca313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f98ccb9-0d00-4d28-a320-e9dec07ef4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:01 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Volume 0557bc16-149e-4cb7-ad53-a05410f0d946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0557bc16-149e-4cb7-ad53-a05410f0d946', 'volume_size': 1} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:01 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-92d7457c-e111-4981-b96f-4b5f082a72ab" returned: 0 in 0.624s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-quobyte-92d7457c-e111-4981-b96f-4b5f082a72ab" released by "delete_volume" :: held 1.542s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Created reservations ['eae1d19b-0cfd-4d9f-94ae-1207498741c9', 'ea4a3c11-ebaa-47b9-baec-84b19a44570c', 'c011d22d-4912-4dbc-b809-f9192636a87a', '4876142b-6332-40f4-9695-28e52d92ab0c'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:01 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:01 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:02 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "cinder-c14e72d5-d189-468b-b683-3d27b3ad9d0b-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.543s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:02 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Deleted volume successfully. Jul 18 06:11:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "cinder-c14e72d5-d189-468b-b683-3d27b3ad9d0b-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2414df09-9391-4eb4-a8f2-115497681f07 tempest-CreateVolumesFromSourceVolumeTest-579221817 None] Lock "cinder-92d7457c-e111-4981-b96f-4b5f082a72ab-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "cinder-quobyte-c14e72d5-d189-468b-b683-3d27b3ad9d0b" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "cinder-quobyte-c14e72d5-d189-468b-b683-3d27b3ad9d0b" acquired by "delete_volume" :: waited 0.046s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0039f7-6191-42e0-b0e5-145b664d684c]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:03 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b Jul 18 06:11:03 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:04 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b" returned: 0 in 1.262s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:04 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b Jul 18 06:11:04 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:04 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c14e72d5-d189-468b-b683-3d27b3ad9d0b" returned: 0 in 0.505s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "cinder-quobyte-c14e72d5-d189-468b-b683-3d27b3ad9d0b" released by "delete_volume" :: held 1.881s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:04 devstack cinder-volume[87750]: WARNING cinder.quota [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-532653551-168017538 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-532653551-168017538, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:11:04 devstack cinder-volume[87750]: WARNING cinder.quota [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-532653551-168017538 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-532653551-168017538, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:11:04 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Created reservations ['316726d7-a961-472d-b4fd-69227f4baaf4', '88c616a8-3a59-4ab0-b9ac-8dce32a8f65f', '08e65848-5ed3-4742-a437-b6de9120cb59', '9d8673df-62f8-4941-a919-e62281b9e60b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:05 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:05 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:05 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219" returned: 0 in 6.098s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e14171c-6ef6-481a-9dbf-a2b5b121681a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:05 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.636s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:05 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Deleted volume successfully. Jul 18 06:11:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b9e05c51-224a-4abf-90a6-8c1e7fcb7f6a tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "cinder-c14e72d5-d189-468b-b683-3d27b3ad9d0b-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:05 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 Jul 18 06:11:05 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:06 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" returned: 0 in 0.844s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:11:06 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Converted 1024.00 MB image at 167.88 MB/s Jul 18 06:11:06 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219 is being set with open permissions: ugo+rw Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:06 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219 Jul 18 06:11:06 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:06 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219" returned: 0 in 0.301s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-quobyte-cd1edd02-929e-483c-a459-8c21bfed4219" released by "_copy_volume_from_snapshot" :: held 8.348s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-quobyte-95dcd2cb-27e1-4fa6-9169-d37e9c1508a6-cd1edd02-929e-483c-a459-8c21bfed4219" released by "_create_volume_from_snapshot" :: held 8.412s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.433s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.553s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-976995874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0557bc16-149e-4cb7-ad53-a05410f0d946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19b76ce8b9d4127a5c7016fb1acabd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:01Z,use_quota=True,user_id='c862ded3a49a40c2ab60e516b1753d20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Creating volume 0557bc16-149e-4cb7-ad53-a05410f0d946 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:11:06 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:06 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 1073741824 Jul 18 06:11:06 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd69d619-e303-4b32-8009-0515cdb82c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1edd02-929e-483c-a459-8c21bfed4219', 'volume_size': 1, 'snapshot_id': '95dcd2cb-27e1-4fa6-9169-d37e9c1508a6'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6aa8888-2f34-4fd2-b5a6-3f657b97e855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:06 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Volume volume-cd1edd02-929e-483c-a459-8c21bfed4219 (cd1edd02-929e-483c-a459-8c21bfed4219): created successfully Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6aa8888-2f34-4fd2-b5a6-3f657b97e855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:06 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Flow 'volume_create_manager' (7dcc866c-b6ef-4821-b2a7-be7774533946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f24c939a-a5ba-4f9d-832d-ebe8ecf2301f tempest-SnapshotDependencyTests-1265741774 None] Created volume successfully. Jul 18 06:11:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "cinder-95dcd2cb-27e1-4fa6-9169-d37e9c1508a6-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-95dcd2cb-27e1-4fa6-9169-d37e9c1508a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "cinder-quobyte-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-quobyte-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "cinder-quobyte-95dcd2cb-27e1-4fa6-9169-d37e9c1508a6" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-quobyte-95dcd2cb-27e1-4fa6-9169-d37e9c1508a6" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Deleting offline snapshot 95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 of volume d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:11:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] snapshot_file for this snap is: volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:11:07 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecf618e-ae92-40aa-9e63-6c25cb37c237]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 1073741824" returned: 0 in 0.852s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:07 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 Jul 18 06:11:07 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:07 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 Jul 18 06:11:07 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:08 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946" returned: 0 in 0.314s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f98ccb9-0d00-4d28-a320-e9dec07ef4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0557bc16-149e-4cb7-ad53-a05410f0d946', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d784ee57-ec78-4554-a05e-79c2f257f389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Volume volume-0557bc16-149e-4cb7-ad53-a05410f0d946 (0557bc16-149e-4cb7-ad53-a05410f0d946): created successfully Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d784ee57-ec78-4554-a05e-79c2f257f389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Flow 'volume_create_manager' (63741515-ed85-43ac-9e41-b72fa3b4058e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3b8d1bd5-847b-4a8c-86f6-390a025b30c9 tempest-VolumesExtendTest-1909230424 None] Created volume successfully. Jul 18 06:11:08 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6" returned: 0 in 0.671s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1851c441-17da-4e94-8735-fd0ca2f83b6b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:08 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 Jul 18 06:11:08 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-16e08dc1-4295-4a49-9699-acb4cc0829a7 req-940cbd27-24de-4143-a9ef-357a5e95c402 tempest-TestInstancesWithCinderVolumes-601950587 None] Terminate volume connection completed successfully. Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-16e08dc1-4295-4a49-9699-acb4cc0829a7 req-940cbd27-24de-4143-a9ef-357a5e95c402 tempest-TestInstancesWithCinderVolumes-601950587 None] Deleting attachment 0dfde222-e595-4c9c-b9de-20862dc1b07a. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:11:08 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" returned: 0 in 0.578s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:08 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 Jul 18 06:11:08 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] Creating offline snapshot d81b850f-bf38-42b0-a205-9ec1d9907b60 of volume 0557bc16-149e-4cb7-ad53-a05410f0d946 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bef19cc-b022-4800-8d02-b2246bf566ab]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:09 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6" returned: 0 in 0.490s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:09 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6 Jul 18 06:11:09 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:09 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 Jul 18 06:11:09 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Flow 'volume_create_manager' (3f0eb6df-4de4-47fc-9749-5e2d128fdf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec91d91d-cf7a-4a76-be08-7428c54b5f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec91d91d-cf7a-4a76-be08-7428c54b5f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62076793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c183f8-1528-48e8-80ee-14c16905df97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cd24f6cbb149c2a7537a368ed1be6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:09Z,use_quota=True,user_id='845f312961684c2c85af42e9f5a88280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16efadcc-24c5-4441-94c0-d0126970b610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16efadcc-24c5-4441-94c0-d0126970b610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a385334e-001f-43c8-9137-b6dd89b7d469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a385334e-001f-43c8-9137-b6dd89b7d469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c183f8-1528-48e8-80ee-14c16905df97', 'volume_name': 'volume-57c183f8-1528-48e8-80ee-14c16905df97', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6315ce8e-44a2-413f-bb4f-4d457689bc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6315ce8e-44a2-413f-bb4f-4d457689bc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfd8923-a02d-4bce-888b-e08d6c187ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:09 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Volume 57c183f8-1528-48e8-80ee-14c16905df97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c183f8-1528-48e8-80ee-14c16905df97', 'volume_size': 1} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:09 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6.95dcd2cb-27e1-4fa6-9169-d37e9c1508a6" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:09 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946" returned: 0 in 0.417s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-quobyte-95dcd2cb-27e1-4fa6-9169-d37e9c1508a6" released by "_delete_snapshot" :: held 2.280s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-quobyte-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" released by "delete_snapshot" :: held 2.326s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:09 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 1G Jul 18 06:11:09 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Created reservations ['8b4b9684-cf8f-49f8-bf37-54241545f841', 'e19cb398-e04c-4f5b-a065-9429f596aef0', '807e6f18-148f-4f8c-9a37-58b3d5a54726', 'e482c049-93e5-4fc6-a002-108d6fbed430'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Delete snapshot completed successfully. Jul 18 06:11:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-82f3e588-889e-47ea-a9d6-5765d4ebb257 tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-95dcd2cb-27e1-4fa6-9169-d37e9c1508a6-delete_snapshot" released by "delete_snapshot" :: held 2.477s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "cinder-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "cinder-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "cinder-quobyte-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "cinder-quobyte-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dfae47-737b-452f-8d86-49c2fe5ad44c]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:10 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 1G" returned: 0 in 0.436s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0557bc16-149e-4cb7-ad53-a05410f0d946 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:10 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 Jul 18 06:11:10 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:10 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0557bc16-149e-4cb7-ad53-a05410f0d946 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 Jul 18 06:11:10 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:10 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9" returned: 0 in 0.381s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:10 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0557bc16-149e-4cb7-ad53-a05410f0d946 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60" returned: 0 in 0.305s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:10 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 is being set with open permissions: ugo+rw Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:10 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9 Jul 18 06:11:10 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:10 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 Jul 18 06:11:10 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "cinder-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "cinder-quobyte-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-quobyte-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf0fef9-733b-4aa9-a6ec-bcea9a667bbd]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:10 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:10 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60" returned: 0 in 0.261s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "cinder-quobyte-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9" released by "delete_volume" :: held 0.691s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:10 devstack cinder-volume[87750]: WARNING cinder.quota [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-388632121-1015802877 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-388632121-1015802877, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:11:10 devstack cinder-volume[87750]: WARNING cinder.quota [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-388632121-1015802877 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-388632121-1015802877, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:11:10 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.info Jul 18 06:11:10 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:10 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 Jul 18 06:11:10 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Created reservations ['2f16872a-5da1-4855-bffa-a655d59aea53', '8be26c3f-2fde-4efd-a0f0-b133cd320438', '3773ba35-4f58-4515-9f53-00c71cc9ab87', '49e22764-91fe-41b4-a93c-3936e96396e5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:10 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:10 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:11 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.info" returned: 0 in 0.270s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:11 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.info is being set with open permissions: ugo+rw Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:11 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:11 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.info Jul 18 06:11:11 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" returned: 0 in 0.384s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:11 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6 Jul 18 06:11:11 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:11 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Deleted volume successfully. Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ec6abfba-c659-4002-b36c-af1e52165ae7 tempest-TestInstancesWithCinderVolumes-601950587 None] Lock "cinder-ce72d38f-ec8b-49e6-bebe-a371cf5fcac9-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:11 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.info" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.749s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-62076793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c183f8-1528-48e8-80ee-14c16905df97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cd24f6cbb149c2a7537a368ed1be6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:09Z,use_quota=True,user_id='845f312961684c2c85af42e9f5a88280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Creating volume 57c183f8-1528-48e8-80ee-14c16905df97 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:11:11 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c183f8-1528-48e8-80ee-14c16905df97 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:11 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" returned: 0 in 0.302s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:11 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c183f8-1528-48e8-80ee-14c16905df97 1073741824 Jul 18 06:11:11 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-quobyte-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6" released by "delete_volume" :: held 0.767s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0d5af38c-3f4a-4709-b319-3ea2efbad8d9 tempest-VolumesExtendTest-1909230424 None] Create snapshot completed successfully Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Created reservations ['30742737-a588-43c5-ab33-c344de7292f8', '21482cd1-3cb6-4681-9de3-6a47e65a8200', '764ad2a6-28e6-4cce-84b9-c286eb583599', '63ae2436-be1d-4849-a4bc-8aa2aa79c587'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:11 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:11 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "cinder-cd1edd02-929e-483c-a459-8c21bfed4219-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-cd1edd02-929e-483c-a459-8c21bfed4219-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "cinder-quobyte-cd1edd02-929e-483c-a459-8c21bfed4219" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-quobyte-cd1edd02-929e-483c-a459-8c21bfed4219" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:11 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1976cb4f-1edf-40ca-8721-c087b7fd7d4b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:11 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c183f8-1528-48e8-80ee-14c16905df97 1073741824" returned: 0 in 0.599s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Deleted volume successfully. Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-160cb52e-1fc0-497c-837f-2e4fcc07f173 tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-d5945a09-ced0-4a3c-a9f8-bb6f2c50eab6-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c183f8-1528-48e8-80ee-14c16905df97 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:12 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c183f8-1528-48e8-80ee-14c16905df97 Jul 18 06:11:12 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:12 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219 Jul 18 06:11:12 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:12 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c183f8-1528-48e8-80ee-14c16905df97" returned: 0 in 0.290s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfd8923-a02d-4bce-888b-e08d6c187ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c183f8-1528-48e8-80ee-14c16905df97', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e627cb2b-8ef7-46e9-ab6f-6e8b7ae00077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Volume volume-57c183f8-1528-48e8-80ee-14c16905df97 (57c183f8-1528-48e8-80ee-14c16905df97): created successfully Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e627cb2b-8ef7-46e9-ab6f-6e8b7ae00077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Flow 'volume_create_manager' (3f0eb6df-4de4-47fc-9749-5e2d128fdf79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:12 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cce5ef5f-204e-4903-90a1-136f4e11f252 tempest-ProjectReaderTests-472696438 None] Created volume successfully. Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219" returned: 0 in 0.468s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:12 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219 Jul 18 06:11:12 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a43835f4-092f-4bd0-9a28-0c5b214b4cfc tempest-VolumesExtendTest-1909230424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a43835f4-092f-4bd0-9a28-0c5b214b4cfc tempest-VolumesExtendTest-1909230424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c7b1f6-789a-435f-b2bb-6e0230eab540]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a43835f4-092f-4bd0-9a28-0c5b214b4cfc tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:12 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cd1edd02-929e-483c-a459-8c21bfed4219" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:12 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 Jul 18 06:11:12 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-quobyte-cd1edd02-929e-483c-a459-8c21bfed4219" released by "delete_volume" :: held 0.822s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Created reservations ['b3abcda5-82d8-426b-a3cf-185d4f66ff98', '52bc4072-9ca3-48c4-a6bd-0258524ca18b', '44dfbe10-56e4-4a8a-a3bd-625247240f69', '12cde1dd-ff85-4142-8753-adc6f7ed4dfa'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Acquiring lock "cinder-57c183f8-1528-48e8-80ee-14c16905df97-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Lock "cinder-57c183f8-1528-48e8-80ee-14c16905df97-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:12 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:12 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Acquiring lock "cinder-quobyte-57c183f8-1528-48e8-80ee-14c16905df97" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Lock "cinder-quobyte-57c183f8-1528-48e8-80ee-14c16905df97" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70b987a-fc98-498e-a3e8-9ee623a07f2a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c183f8-1528-48e8-80ee-14c16905df97 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:13 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a43835f4-092f-4bd0-9a28-0c5b214b4cfc tempest-VolumesExtendTest-1909230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946" returned: 0 in 0.509s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a43835f4-092f-4bd0-9a28-0c5b214b4cfc tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 2G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:13 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c183f8-1528-48e8-80ee-14c16905df97 Jul 18 06:11:13 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:13 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.435s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a43835f4-092f-4bd0-9a28-0c5b214b4cfc tempest-VolumesExtendTest-1909230424 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 2G" returned: 0 in 0.194s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a43835f4-092f-4bd0-9a28-0c5b214b4cfc tempest-VolumesExtendTest-1909230424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.770s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Deleted volume successfully. Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2cfb5066-18fe-49df-91b1-1a0ca8d1166b tempest-SnapshotDependencyTests-1265741774 None] Lock "cinder-cd1edd02-929e-483c-a459-8c21bfed4219-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a43835f4-092f-4bd0-9a28-0c5b214b4cfc tempest-VolumesExtendTest-1909230424 None] Extend volume completed successfully. Jul 18 06:11:13 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c183f8-1528-48e8-80ee-14c16905df97" returned: 0 in 0.490s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c183f8-1528-48e8-80ee-14c16905df97 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:13 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c183f8-1528-48e8-80ee-14c16905df97 Jul 18 06:11:13 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:13 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "cinder-d81b850f-bf38-42b0-a205-9ec1d9907b60-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-57c183f8-1528-48e8-80ee-14c16905df97" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Lock "cinder-quobyte-57c183f8-1528-48e8-80ee-14c16905df97" released by "delete_volume" :: held 0.832s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-d81b850f-bf38-42b0-a205-9ec1d9907b60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "cinder-quobyte-0557bc16-149e-4cb7-ad53-a05410f0d946" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-quobyte-0557bc16-149e-4cb7-ad53-a05410f0d946" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "cinder-quobyte-d81b850f-bf38-42b0-a205-9ec1d9907b60" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-quobyte-d81b850f-bf38-42b0-a205-9ec1d9907b60" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Deleting offline snapshot d81b850f-bf38-42b0-a205-9ec1d9907b60 of volume 0557bc16-149e-4cb7-ad53-a05410f0d946 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] snapshot_file for this snap is: volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ff8690-d366-4b2d-8e85-b7ded77ba4c6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Created reservations ['279785b9-110d-46e5-bd74-70f36687526c', '23c673bc-d054-4192-a630-a7eba64ca805', '3d9e550c-1d9e-4024-be99-770d9da2e16f', '357851f9-aaf1-4ae9-811d-52b08477875a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:14 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 Jul 18 06:11:14 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:14 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:14 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:14 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.295s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Deleted volume successfully. Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-54af6865-d92e-4b41-8774-d12ddcb2570b tempest-ProjectReaderTests-472696438 None] Lock "cinder-57c183f8-1528-48e8-80ee-14c16905df97-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:14 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60" returned: 0 in 0.550s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0557bc16-149e-4cb7-ad53-a05410f0d946(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5ef447-837b-4456-a6c0-1c0e0a2e60e3]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:14 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 Jul 18 06:11:14 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:15 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946" returned: 0 in 0.420s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:15 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 Jul 18 06:11:15 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:15 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60" returned: 0 in 0.598s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:15 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60 Jul 18 06:11:15 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:15 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:11:15 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Flow 'volume_create_manager' (3a8aef55-6885-46e5-8043-b02c15e04933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a643193-05c2-47ce-bbf1-494b39a86e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946.d81b850f-bf38-42b0-a205-9ec1d9907b60" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a643193-05c2-47ce-bbf1-494b39a86e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383187813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97abead-bdfc-49ac-9e75-814dd601555b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cd24f6cbb149c2a7537a368ed1be6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:16Z,use_quota=True,user_id='845f312961684c2c85af42e9f5a88280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dedc809-1f27-4ea0-afef-048f3f9650a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dedc809-1f27-4ea0-afef-048f3f9650a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a0332e-170b-4171-be8b-135f0727dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a0332e-170b-4171-be8b-135f0727dea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97abead-bdfc-49ac-9e75-814dd601555b', 'volume_name': 'volume-c97abead-bdfc-49ac-9e75-814dd601555b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bfcfa8-c9bd-44de-9126-73ee22292735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bfcfa8-c9bd-44de-9126-73ee22292735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dddd035-dbba-4bd5-a2d2-9f7ed5232c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Volume c97abead-bdfc-49ac-9e75-814dd601555b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97abead-bdfc-49ac-9e75-814dd601555b', 'volume_size': 1} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383187813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97abead-bdfc-49ac-9e75-814dd601555b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cd24f6cbb149c2a7537a368ed1be6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:16Z,use_quota=True,user_id='845f312961684c2c85af42e9f5a88280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Creating volume c97abead-bdfc-49ac-9e75-814dd601555b {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:11:16 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c97abead-bdfc-49ac-9e75-814dd601555b 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:16 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c97abead-bdfc-49ac-9e75-814dd601555b 1073741824 Jul 18 06:11:16 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-quobyte-d81b850f-bf38-42b0-a205-9ec1d9907b60" released by "_delete_snapshot" :: held 2.187s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-quobyte-0557bc16-149e-4cb7-ad53-a05410f0d946" released by "delete_snapshot" :: held 2.225s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Created reservations ['85b8e885-2510-42bb-b57a-fab4143de319', '46b07019-cf48-49ce-bbca-195859bd45be', '1d41103b-9473-40e2-8a38-b640ed57ed7b', '83f0a534-a35f-4414-bcff-2993524d501f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Delete snapshot completed successfully. Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-461ce794-3611-4fc0-be68-0315dcad13d1 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-d81b850f-bf38-42b0-a205-9ec1d9907b60-delete_snapshot" released by "delete_snapshot" :: held 2.476s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:16 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c97abead-bdfc-49ac-9e75-814dd601555b 1073741824" returned: 0 in 0.714s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c97abead-bdfc-49ac-9e75-814dd601555b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:16 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c97abead-bdfc-49ac-9e75-814dd601555b Jul 18 06:11:16 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:17 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c97abead-bdfc-49ac-9e75-814dd601555b" returned: 0 in 0.333s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dddd035-dbba-4bd5-a2d2-9f7ed5232c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97abead-bdfc-49ac-9e75-814dd601555b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af28f48-25cb-45bf-8d47-c6cc888ca430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "cinder-0557bc16-149e-4cb7-ad53-a05410f0d946-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:17 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Volume volume-c97abead-bdfc-49ac-9e75-814dd601555b (c97abead-bdfc-49ac-9e75-814dd601555b): created successfully Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af28f48-25cb-45bf-8d47-c6cc888ca430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Flow 'volume_create_manager' (3a8aef55-6885-46e5-8043-b02c15e04933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-0557bc16-149e-4cb7-ad53-a05410f0d946-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f39d7412-4f65-455e-a1ec-416a836c807e tempest-ProjectReaderTests-472696438 None] Created volume successfully. Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "cinder-quobyte-0557bc16-149e-4cb7-ad53-a05410f0d946" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-quobyte-0557bc16-149e-4cb7-ad53-a05410f0d946" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0e8716-430f-4f69-a1f9-f42604781afa]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:17 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 Jul 18 06:11:17 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:17 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946" returned: 0 in 0.502s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:17 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946 Jul 18 06:11:17 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Acquiring lock "cinder-c97abead-bdfc-49ac-9e75-814dd601555b-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Lock "cinder-c97abead-bdfc-49ac-9e75-814dd601555b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Acquiring lock "cinder-quobyte-c97abead-bdfc-49ac-9e75-814dd601555b" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Lock "cinder-quobyte-c97abead-bdfc-49ac-9e75-814dd601555b" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4908ce-120f-4351-984b-1bf076a4d0e2]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c97abead-bdfc-49ac-9e75-814dd601555b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:18 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-0557bc16-149e-4cb7-ad53-a05410f0d946" returned: 0 in 0.414s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-quobyte-0557bc16-149e-4cb7-ad53-a05410f0d946" released by "delete_volume" :: held 1.003s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:18 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c97abead-bdfc-49ac-9e75-814dd601555b Jul 18 06:11:18 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Created reservations ['b7f02519-e4d9-4f4f-8f38-2d154b33b2f0', '72ec94e7-3d2f-4155-828b-31d68be1ea0b', 'cea55f04-c28b-4e0a-8944-303a6808236b', 'e2dfb6b0-042e-445e-99a7-a6ec254b4997'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:18 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:18 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:18 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c97abead-bdfc-49ac-9e75-814dd601555b" returned: 0 in 0.509s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c97abead-bdfc-49ac-9e75-814dd601555b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:18 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c97abead-bdfc-49ac-9e75-814dd601555b Jul 18 06:11:18 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:18 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Deleted volume successfully. Jul 18 06:11:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cba887b3-0a8d-4fe6-bdbd-f7b140a514f2 tempest-VolumesExtendTest-1909230424 None] Lock "cinder-0557bc16-149e-4cb7-ad53-a05410f0d946-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:19 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c97abead-bdfc-49ac-9e75-814dd601555b" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Lock "cinder-quobyte-c97abead-bdfc-49ac-9e75-814dd601555b" released by "delete_volume" :: held 0.854s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Created reservations ['b6b31461-3253-46ae-b2d3-811947e69388', '8436dcfd-a1c3-4b17-935c-87e3233c9f32', '35031b41-3f87-4a52-811c-1bf90c322324', 'a5cfe11c-aa0f-4c9a-95a0-401d874f27fe'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:19 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:19 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:19 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.367s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Deleted volume successfully. Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4a03b49f-55d6-4359-b9d6-f005119eb56f tempest-ProjectReaderTests-472696438 None] Lock "cinder-c97abead-bdfc-49ac-9e75-814dd601555b-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Flow 'volume_create_manager' (174d1756-8ea9-4dd7-8339-f17a5314e4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668a59b7-1b2c-41f7-985a-e37dee54bfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668a59b7-1b2c-41f7-985a-e37dee54bfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045905189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fb746d-79ca-46e0-9eeb-bfff18bef305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cd24f6cbb149c2a7537a368ed1be6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:20Z,use_quota=True,user_id='845f312961684c2c85af42e9f5a88280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e915bf17-7cd7-41c7-b1be-74018be7bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e915bf17-7cd7-41c7-b1be-74018be7bc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f695b6-9cc4-4fdb-9050-594420346205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f695b6-9cc4-4fdb-9050-594420346205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5fb746d-79ca-46e0-9eeb-bfff18bef305', 'volume_name': 'volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c4febc-b013-4dd8-8056-6018d9d16d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c4febc-b013-4dd8-8056-6018d9d16d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee859d28-3129-4134-b67f-2831a6b9e8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Volume c5fb746d-79ca-46e0-9eeb-bfff18bef305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305', 'volume_size': 1} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2045905189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fb746d-79ca-46e0-9eeb-bfff18bef305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cd24f6cbb149c2a7537a368ed1be6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:20Z,use_quota=True,user_id='845f312961684c2c85af42e9f5a88280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Creating volume c5fb746d-79ca-46e0-9eeb-bfff18bef305 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:11:20 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:20 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305 1073741824 Jul 18 06:11:20 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:20 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305 1073741824" returned: 0 in 0.624s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:20 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305 Jul 18 06:11:20 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:21 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:21 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:11:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee859d28-3129-4134-b67f-2831a6b9e8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79232a2-3f37-43b3-a6c2-686490c4ee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Volume volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305 (c5fb746d-79ca-46e0-9eeb-bfff18bef305): created successfully Jul 18 06:11:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79232a2-3f37-43b3-a6c2-686490c4ee92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Flow 'volume_create_manager' (174d1756-8ea9-4dd7-8339-f17a5314e4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-de3c90f7-ba1a-4d20-8554-dc87dcaf26b0 tempest-ProjectReaderTests-472696438 None] Created volume successfully. Jul 18 06:11:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Acquiring lock "cinder-c5fb746d-79ca-46e0-9eeb-bfff18bef305-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Lock "cinder-c5fb746d-79ca-46e0-9eeb-bfff18bef305-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:22 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=170,cinder:INSERT=51,cinder:UPDATE=210,cinder:DELETE=16 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:11:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Acquiring lock "cinder-quobyte-c5fb746d-79ca-46e0-9eeb-bfff18bef305" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Lock "cinder-quobyte-c5fb746d-79ca-46e0-9eeb-bfff18bef305" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1822ef98-efbb-49b5-95ee-ee9e92de760a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:22 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305 Jul 18 06:11:22 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:23 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305" returned: 0 in 0.520s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:23 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305 Jul 18 06:11:23 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:23 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c5fb746d-79ca-46e0-9eeb-bfff18bef305" returned: 0 in 0.327s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Lock "cinder-quobyte-c5fb746d-79ca-46e0-9eeb-bfff18bef305" released by "delete_volume" :: held 0.903s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Created reservations ['7518ea7e-8c76-475d-8392-c4ab4bc33e9a', 'b0936908-2fad-4c4e-9244-543674e52e6b', '64b893a4-87af-4265-abca-ad297bcf25a1', 'eb7ccd9d-f921-42df-8124-e238c1472c8f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:23 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:23 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:23 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.282s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Deleted volume successfully. Jul 18 06:11:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-8761aa2c-2c07-468f-865c-462d1f24f355 tempest-ProjectReaderTests-472696438 None] Lock "cinder-c5fb746d-79ca-46e0-9eeb-bfff18bef305-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Flow 'volume_create_manager' (f557034a-ff55-4f28-9225-cf344b5c9562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b298999-57d0-4bfc-b710-a42d186ac518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b298999-57d0-4bfc-b710-a42d186ac518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290660431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480ef06c-8993-4214-8fa2-3c610d421af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cd24f6cbb149c2a7537a368ed1be6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:25Z,use_quota=True,user_id='845f312961684c2c85af42e9f5a88280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72826090-19d7-45fc-9cfa-fad2a7a90cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72826090-19d7-45fc-9cfa-fad2a7a90cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231613c1-8f5d-4fb2-8756-8ef33cf4ccc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231613c1-8f5d-4fb2-8756-8ef33cf4ccc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '480ef06c-8993-4214-8fa2-3c610d421af7', 'volume_name': 'volume-480ef06c-8993-4214-8fa2-3c610d421af7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194ca6e3-9249-4df9-be74-3075c56cecdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194ca6e3-9249-4df9-be74-3075c56cecdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a60134e-ad2d-40bb-9b54-f684f8bc3e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Volume 480ef06c-8993-4214-8fa2-3c610d421af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-480ef06c-8993-4214-8fa2-3c610d421af7', 'volume_size': 1} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290660431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=480ef06c-8993-4214-8fa2-3c610d421af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cd24f6cbb149c2a7537a368ed1be6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:25Z,use_quota=True,user_id='845f312961684c2c85af42e9f5a88280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Creating volume 480ef06c-8993-4214-8fa2-3c610d421af7 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:11:25 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:11:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-480ef06c-8993-4214-8fa2-3c610d421af7 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:25 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-480ef06c-8993-4214-8fa2-3c610d421af7 1073741824 Jul 18 06:11:25 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:26 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-480ef06c-8993-4214-8fa2-3c610d421af7 1073741824" returned: 0 in 0.591s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-480ef06c-8993-4214-8fa2-3c610d421af7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:26 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-480ef06c-8993-4214-8fa2-3c610d421af7 Jul 18 06:11:26 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:26 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-480ef06c-8993-4214-8fa2-3c610d421af7" returned: 0 in 0.345s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:11:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a60134e-ad2d-40bb-9b54-f684f8bc3e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-480ef06c-8993-4214-8fa2-3c610d421af7', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6156303-3267-4011-a089-9d050805cab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:26 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Volume volume-480ef06c-8993-4214-8fa2-3c610d421af7 (480ef06c-8993-4214-8fa2-3c610d421af7): created successfully Jul 18 06:11:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6156303-3267-4011-a089-9d050805cab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:26 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Flow 'volume_create_manager' (f557034a-ff55-4f28-9225-cf344b5c9562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fcd1e095-6cd7-485c-bfa0-432992220eb5 tempest-ProjectReaderTests-472696438 None] Created volume successfully. Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Acquiring lock "cinder-480ef06c-8993-4214-8fa2-3c610d421af7-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Lock "cinder-480ef06c-8993-4214-8fa2-3c610d421af7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Acquiring lock "cinder-quobyte-480ef06c-8993-4214-8fa2-3c610d421af7" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Lock "cinder-quobyte-480ef06c-8993-4214-8fa2-3c610d421af7" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b3493b-6417-4caf-9e2f-3aaee09530f1]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-480ef06c-8993-4214-8fa2-3c610d421af7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:27 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-480ef06c-8993-4214-8fa2-3c610d421af7 Jul 18 06:11:27 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Flow 'volume_create_manager' (c5b0a8e8-64f1-498d-95b6-e5bdb02758a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2f937c-8b76-4fd5-9552-1e04983add30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e2f937c-8b76-4fd5-9552-1e04983add30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29d7353-809a-4b8f-abf1-733df1d756fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea3a804d46f4e5f9673e1dd60c0daef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:28Z,use_quota=True,user_id='893ce1b700f9425e9edf7c8bbb296077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c313a92-2d20-4f4b-a2c4-5d1f3f43cf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c313a92-2d20-4f4b-a2c4-5d1f3f43cf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257ae165-0b18-407b-8009-8e8e1e3a4a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257ae165-0b18-407b-8009-8e8e1e3a4a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e29d7353-809a-4b8f-abf1-733df1d756fd', 'volume_name': 'volume-e29d7353-809a-4b8f-abf1-733df1d756fd', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e1bc7c-ace3-4729-8d75-b519fa4aefe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e1bc7c-ace3-4729-8d75-b519fa4aefe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2dff5a-e02f-401b-bcc8-db836cfd4d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:27 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Volume e29d7353-809a-4b8f-abf1-733df1d756fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e29d7353-809a-4b8f-abf1-733df1d756fd', 'volume_size': 1} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e29d7353-809a-4b8f-abf1-733df1d756fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea3a804d46f4e5f9673e1dd60c0daef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:28Z,use_quota=True,user_id='893ce1b700f9425e9edf7c8bbb296077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Creating volume e29d7353-809a-4b8f-abf1-733df1d756fd {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:11:27 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:11:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e29d7353-809a-4b8f-abf1-733df1d756fd 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:27 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e29d7353-809a-4b8f-abf1-733df1d756fd 1073741824 Jul 18 06:11:27 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:28 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-480ef06c-8993-4214-8fa2-3c610d421af7" returned: 0 in 0.402s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-480ef06c-8993-4214-8fa2-3c610d421af7 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:28 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-480ef06c-8993-4214-8fa2-3c610d421af7 Jul 18 06:11:28 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:28 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-480ef06c-8993-4214-8fa2-3c610d421af7" returned: 0 in 0.282s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Lock "cinder-quobyte-480ef06c-8993-4214-8fa2-3c610d421af7" released by "delete_volume" :: held 0.738s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Created reservations ['2f543849-91e1-42fd-8adf-a68f470a1fc6', '86967a01-29b2-4a3d-a3ba-0558c18b0e83', 'b5a6b3f2-7493-41d5-8112-69f66d184af5', 'ceace956-eaf6-46ff-87a1-d2a576e5fdfd'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:28 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:28 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:28 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e29d7353-809a-4b8f-abf1-733df1d756fd 1073741824" returned: 0 in 0.545s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e29d7353-809a-4b8f-abf1-733df1d756fd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:28 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e29d7353-809a-4b8f-abf1-733df1d756fd Jul 18 06:11:28 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:28 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Deleted volume successfully. Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfb98546-65cb-430c-afb3-b4d936f47bdd tempest-ProjectReaderTests-472696438 None] Lock "cinder-480ef06c-8993-4214-8fa2-3c610d421af7-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:28 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e29d7353-809a-4b8f-abf1-733df1d756fd" returned: 0 in 0.310s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2dff5a-e02f-401b-bcc8-db836cfd4d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e29d7353-809a-4b8f-abf1-733df1d756fd', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc706650-80af-4d0d-be02-8de092b69a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:28 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Volume volume-e29d7353-809a-4b8f-abf1-733df1d756fd (e29d7353-809a-4b8f-abf1-733df1d756fd): created successfully Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc706650-80af-4d0d-be02-8de092b69a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Flow 'volume_create_manager' (c5b0a8e8-64f1-498d-95b6-e5bdb02758a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-36ea76e6-fcbf-4796-aee6-be523512ec26 tempest-CinderUnicodeTest-1728294910 None] Created volume successfully. Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Flow 'volume_create_manager' (54ef80dc-a42e-4cca-8859-b304b4fdbb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f8779d-362e-4301-87b6-5860163cfca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f8779d-362e-4301-87b6-5860163cfca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2002629710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af88f62-1822-4dd3-83a9-e0b9769c731f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea3a804d46f4e5f9673e1dd60c0daef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:31Z,use_quota=True,user_id='893ce1b700f9425e9edf7c8bbb296077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6e0c62-aeca-4a5d-80c9-8c35419cd332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b6e0c62-aeca-4a5d-80c9-8c35419cd332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031223b3-0833-4c29-88b9-3c52777aeb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031223b3-0833-4c29-88b9-3c52777aeb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af88f62-1822-4dd3-83a9-e0b9769c731f', 'volume_name': 'volume-6af88f62-1822-4dd3-83a9-e0b9769c731f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9322e9-285f-4338-9bf4-b200133388ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9322e9-285f-4338-9bf4-b200133388ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec63d277-3b53-4061-9f72-cd84b63e6cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:30 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Volume 6af88f62-1822-4dd3-83a9-e0b9769c731f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af88f62-1822-4dd3-83a9-e0b9769c731f', 'volume_size': 1} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2002629710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af88f62-1822-4dd3-83a9-e0b9769c731f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ea3a804d46f4e5f9673e1dd60c0daef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:31Z,use_quota=True,user_id='893ce1b700f9425e9edf7c8bbb296077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Creating volume 6af88f62-1822-4dd3-83a9-e0b9769c731f {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:11:30 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:11:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:30 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f 1073741824 Jul 18 06:11:30 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:31 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f 1073741824" returned: 0 in 0.658s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:31 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f Jul 18 06:11:31 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:31 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f" returned: 0 in 0.272s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:11:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec63d277-3b53-4061-9f72-cd84b63e6cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af88f62-1822-4dd3-83a9-e0b9769c731f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9adbb93-0721-4b2b-80f7-5033583ec9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:31 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Volume volume-6af88f62-1822-4dd3-83a9-e0b9769c731f (6af88f62-1822-4dd3-83a9-e0b9769c731f): created successfully Jul 18 06:11:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9adbb93-0721-4b2b-80f7-5033583ec9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:31 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Flow 'volume_create_manager' (54ef80dc-a42e-4cca-8859-b304b4fdbb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c91f471c-0090-46f2-8ed1-0043ef15f34f tempest-CinderUnicodeTest-1728294910 None] Created volume successfully. Jul 18 06:11:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] Creating offline snapshot a26b8572-7919-4122-a177-19127bd82562 of volume 6af88f62-1822-4dd3-83a9-e0b9769c731f {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:11:32 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa034560-5c8b-4161-a7b3-91609a8e51e1]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:33 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f Jul 18 06:11:33 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:33 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f" returned: 0 in 0.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:33 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 1G Jul 18 06:11:33 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:33 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 1G" returned: 0 in 0.456s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af88f62-1822-4dd3-83a9-e0b9769c731f -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:33 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af88f62-1822-4dd3-83a9-e0b9769c731f -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 Jul 18 06:11:33 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:34 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af88f62-1822-4dd3-83a9-e0b9769c731f -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562" returned: 0 in 0.318s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:34 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 is being set with open permissions: ugo+rw Jul 18 06:11:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:34 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 Jul 18 06:11:34 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:34 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562" returned: 0 in 0.249s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:34 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.info Jul 18 06:11:34 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:34 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.info" returned: 0 in 0.264s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:34 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.info is being set with open permissions: ugo+rw Jul 18 06:11:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:34 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.info Jul 18 06:11:34 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:35 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.info" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:35 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0465fbcf-05ab-4e57-8cee-640e93a1e0cb tempest-CinderUnicodeTest-1728294910 None] Create snapshot completed successfully Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:35 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:35 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:35 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:11:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "cinder-a26b8572-7919-4122-a177-19127bd82562-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-a26b8572-7919-4122-a177-19127bd82562-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "cinder-quobyte-6af88f62-1822-4dd3-83a9-e0b9769c731f" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-quobyte-6af88f62-1822-4dd3-83a9-e0b9769c731f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "cinder-quobyte-a26b8572-7919-4122-a177-19127bd82562" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-quobyte-a26b8572-7919-4122-a177-19127bd82562" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Deleting offline snapshot a26b8572-7919-4122-a177-19127bd82562 of volume 6af88f62-1822-4dd3-83a9-e0b9769c731f {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] snapshot_file for this snap is: volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a92570-4455-4943-b3fc-bf65e9374b2d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:36 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 Jul 18 06:11:36 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:36 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562" returned: 0 in 0.449s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6af88f62-1822-4dd3-83a9-e0b9769c731f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa7a2b5-eecc-41d6-a05b-03531bbb35c0]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:36 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f Jul 18 06:11:36 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:37 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f" returned: 0 in 0.417s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:37 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 Jul 18 06:11:37 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:37 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562" returned: 0 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:37 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562 Jul 18 06:11:37 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:37 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f.a26b8572-7919-4122-a177-19127bd82562" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-quobyte-a26b8572-7919-4122-a177-19127bd82562" released by "_delete_snapshot" :: held 1.649s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-quobyte-6af88f62-1822-4dd3-83a9-e0b9769c731f" released by "delete_snapshot" :: held 1.670s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:37 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Created reservations ['f7fded37-c978-4d5b-82fe-8330577e3d1e', 'f32e5e4a-8d5f-4b22-9e9b-8c85fac6e2f2', '8f369b31-cbba-44b6-a634-29c5a4394e42', 'cd505bef-c847-4db7-9593-09b6a151f8ce'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Delete snapshot completed successfully. Jul 18 06:11:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9908ad42-65c9-4128-b919-9d7bacf1ff9a tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-a26b8572-7919-4122-a177-19127bd82562-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "cinder-6af88f62-1822-4dd3-83a9-e0b9769c731f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-6af88f62-1822-4dd3-83a9-e0b9769c731f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "cinder-quobyte-6af88f62-1822-4dd3-83a9-e0b9769c731f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-quobyte-6af88f62-1822-4dd3-83a9-e0b9769c731f" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:38 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7e5135-bc26-4b17-ae3a-ed2039d7563f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:38 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f Jul 18 06:11:38 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:38 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f" returned: 0 in 0.382s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:38 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f Jul 18 06:11:38 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:39 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6af88f62-1822-4dd3-83a9-e0b9769c731f" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-quobyte-6af88f62-1822-4dd3-83a9-e0b9769c731f" released by "delete_volume" :: held 0.722s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Created reservations ['78805e25-ad19-4942-8769-cb50b69868eb', '51ef6410-a1c3-4318-a844-cbd96d5aedc7', '9f197f91-6251-4aa8-baca-aeb1df799042', '71a074c6-5457-4b9c-b77e-90639d0f7794'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:39 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:39 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "cinder-e29d7353-809a-4b8f-abf1-733df1d756fd-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-e29d7353-809a-4b8f-abf1-733df1d756fd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:39 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.270s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Deleted volume successfully. Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=235,cinder:SELECT=183,cinder:DELETE=20,cinder:INSERT=66 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-429ed185-8d69-498c-9cee-477e26b3b3b6 tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-6af88f62-1822-4dd3-83a9-e0b9769c731f-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "cinder-quobyte-e29d7353-809a-4b8f-abf1-733df1d756fd" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-quobyte-e29d7353-809a-4b8f-abf1-733df1d756fd" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fe9778-21ca-48c4-a8a7-e0f2e7178922]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:11:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e29d7353-809a-4b8f-abf1-733df1d756fd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:39 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e29d7353-809a-4b8f-abf1-733df1d756fd Jul 18 06:11:39 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:40 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e29d7353-809a-4b8f-abf1-733df1d756fd" returned: 0 in 0.385s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e29d7353-809a-4b8f-abf1-733df1d756fd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:40 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e29d7353-809a-4b8f-abf1-733df1d756fd Jul 18 06:11:40 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:40 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e29d7353-809a-4b8f-abf1-733df1d756fd" returned: 0 in 0.252s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-quobyte-e29d7353-809a-4b8f-abf1-733df1d756fd" released by "delete_volume" :: held 0.676s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Created reservations ['9d5ab577-2abf-4c54-a63b-dcee0adcc4d1', '45d0b96f-0d6b-41e6-9d15-f0530037355d', 'c2b55914-d86e-49de-8129-efb3273bc39c', 'cd56e50b-1ad4-433c-9fe1-f74e66b7c060'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:40 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:11:40 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:40 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.261s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:11:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Deleted volume successfully. Jul 18 06:11:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f3109d5b-7c7e-486b-9358-2ba4819ae62e tempest-CinderUnicodeTest-1728294910 None] Lock "cinder-e29d7353-809a-4b8f-abf1-733df1d756fd-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Flow 'volume_create_manager' (e4794663-74b1-41a8-862b-8a7f3b120f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9afdd23-7b0d-4f22-aac0-67225784036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9afdd23-7b0d-4f22-aac0-67225784036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-595878913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99eb385-0e5b-43d3-b432-e85677aa2a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5699a906c3a4be3888bf272994ae566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:48Z,use_quota=True,user_id='de89dbda75d44ae4841ee33cd9146e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72083ef6-da58-4c6f-840c-25307cb04ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72083ef6-da58-4c6f-840c-25307cb04ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac982bc6-fad4-458d-9164-94f2f2dc13af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac982bc6-fad4-458d-9164-94f2f2dc13af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99eb385-0e5b-43d3-b432-e85677aa2a9c', 'volume_name': 'volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95df82c0-6b48-40b5-9cd1-ef77b5bcf5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95df82c0-6b48-40b5-9cd1-ef77b5bcf5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c64584-0ba5-4293-ac13-59ba4f3d0ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:47 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Volume c99eb385-0e5b-43d3-b432-e85677aa2a9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c', 'volume_size': 1} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-595878913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99eb385-0e5b-43d3-b432-e85677aa2a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5699a906c3a4be3888bf272994ae566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:48Z,use_quota=True,user_id='de89dbda75d44ae4841ee33cd9146e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Creating volume c99eb385-0e5b-43d3-b432-e85677aa2a9c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:11:47 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:11:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:47 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c 1073741824 Jul 18 06:11:47 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Flow 'volume_create_manager' (f9f023f4-2d35-421a-9ced-e0db16a55598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269ebb46-2950-4f17-b943-a889553e3807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269ebb46-2950-4f17-b943-a889553e3807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-119405515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5a9e30-40c5-4279-b9c9-a3eea074385b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5699a906c3a4be3888bf272994ae566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:48Z,use_quota=True,user_id='de89dbda75d44ae4841ee33cd9146e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3dcabc-f0e1-46c9-9352-cc6edbceeda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3dcabc-f0e1-46c9-9352-cc6edbceeda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea79fcd1-5880-494f-9cb9-86ffa93de7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea79fcd1-5880-494f-9cb9-86ffa93de7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5a9e30-40c5-4279-b9c9-a3eea074385b', 'volume_name': 'volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4cb311-c6e6-4573-ae28-ccf9edd5bdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4cb311-c6e6-4573-ae28-ccf9edd5bdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f33fc8-7227-44e0-96a8-fbc9635d87b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:48 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Volume 1b5a9e30-40c5-4279-b9c9-a3eea074385b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b', 'volume_size': 1} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:48 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c 1073741824" returned: 0 in 0.645s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:48 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c Jul 18 06:11:48 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:48 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c" returned: 0 in 0.337s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-119405515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5a9e30-40c5-4279-b9c9-a3eea074385b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5699a906c3a4be3888bf272994ae566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:11:48Z,use_quota=True,user_id='de89dbda75d44ae4841ee33cd9146e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Creating volume 1b5a9e30-40c5-4279-b9c9-a3eea074385b {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:11:48 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c64584-0ba5-4293-ac13-59ba4f3d0ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:48 devstack sudo[103144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b 1073741824 Jul 18 06:11:48 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d93cb28-2905-4551-8403-3b6d90c6eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Volume volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c (c99eb385-0e5b-43d3-b432-e85677aa2a9c): created successfully Jul 18 06:11:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d93cb28-2905-4551-8403-3b6d90c6eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Flow 'volume_create_manager' (e4794663-74b1-41a8-862b-8a7f3b120f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ce2c7057-5c35-4e0f-aacf-35e4528c7c21 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Created volume successfully. Jul 18 06:11:49 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b 1073741824" returned: 0 in 0.561s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:11:49 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b Jul 18 06:11:49 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:11:49 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jul 18 06:11:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:11:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:11:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:11:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f33fc8-7227-44e0-96a8-fbc9635d87b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87187e8-5dfa-42d3-a07a-a39b8bec9aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:11:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Volume volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b (1b5a9e30-40c5-4279-b9c9-a3eea074385b): created successfully Jul 18 06:11:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87187e8-5dfa-42d3-a07a-a39b8bec9aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:11:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Flow 'volume_create_manager' (f9f023f4-2d35-421a-9ced-e0db16a55598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:11:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b9363313-352c-425a-9234-8be8faeb3d8f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Created volume successfully. Jul 18 06:11:59 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=36,cinder:INSERT=13,cinder:UPDATE=52,cinder:DELETE=5 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:11:59 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=10,cinder:INSERT=2,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:12:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-a72a2c07-7bc1-4b9e-b5a5-1252bada9118 req-ffc9af27-917c-40b6-b444-0918dcda2b9f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:12:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-a72a2c07-7bc1-4b9e-b5a5-1252bada9118 req-ffc9af27-917c-40b6-b444-0918dcda2b9f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:12:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-a72a2c07-7bc1-4b9e-b5a5-1252bada9118 req-ffc9af27-917c-40b6-b444-0918dcda2b9f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:12:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-a72a2c07-7bc1-4b9e-b5a5-1252bada9118 req-ffc9af27-917c-40b6-b444-0918dcda2b9f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2daca63-735f-4ebd-a7cb-83821bfd30b0', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:12:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-a72a2c07-7bc1-4b9e-b5a5-1252bada9118 req-ffc9af27-917c-40b6-b444-0918dcda2b9f tempest-TestServerVolumeAttachmentScenario-1420137008 None] attachment_update completed successfully. Jul 18 06:12:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-a68b4c50-4121-469b-9b7a-f462bc2746fc req-35f8ea8a-da2f-447d-b919-d61a2f62036f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:12:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-a68b4c50-4121-469b-9b7a-f462bc2746fc req-35f8ea8a-da2f-447d-b919-d61a2f62036f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:12:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-a68b4c50-4121-469b-9b7a-f462bc2746fc req-35f8ea8a-da2f-447d-b919-d61a2f62036f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:12:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-a68b4c50-4121-469b-9b7a-f462bc2746fc req-35f8ea8a-da2f-447d-b919-d61a2f62036f tempest-TestServerVolumeAttachmentScenario-1420137008 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4e6b082-146d-4b50-b6a5-c98db27433e4', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:12:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-a68b4c50-4121-469b-9b7a-f462bc2746fc req-35f8ea8a-da2f-447d-b919-d61a2f62036f tempest-TestServerVolumeAttachmentScenario-1420137008 None] attachment_update completed successfully. Jul 18 06:12:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-7d5fc4f7-117d-4825-af92-1dff33fb8b27 req-25e1c8e3-9302-472e-aabb-bb802ccc75ef tempest-TestServerVolumeAttachmentScenario-1420137008 None] Terminate volume connection completed successfully. Jul 18 06:12:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-7d5fc4f7-117d-4825-af92-1dff33fb8b27 req-25e1c8e3-9302-472e-aabb-bb802ccc75ef tempest-TestServerVolumeAttachmentScenario-1420137008 None] Deleting attachment c4e6b082-146d-4b50-b6a5-c98db27433e4. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:12:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-95e04de2-ef6b-4235-9a2c-cec0de3347f5 req-63798999-a5f5-498f-b973-c62c366423b8 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Terminate volume connection completed successfully. Jul 18 06:12:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-95e04de2-ef6b-4235-9a2c-cec0de3347f5 req-63798999-a5f5-498f-b973-c62c366423b8 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Deleting attachment f2daca63-735f-4ebd-a7cb-83821bfd30b0. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:12:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Acquiring lock "cinder-1b5a9e30-40c5-4279-b9c9-a3eea074385b-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:12:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "cinder-1b5a9e30-40c5-4279-b9c9-a3eea074385b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:12:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Acquiring lock "cinder-quobyte-1b5a9e30-40c5-4279-b9c9-a3eea074385b" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:12:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "cinder-quobyte-1b5a9e30-40c5-4279-b9c9-a3eea074385b" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:12:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9763a318-bf15-4f68-a512-cf7f934e79bb]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:12:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:12:30 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b Jul 18 06:12:30 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:12:30 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jul 18 06:12:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b" returned: 0 in 0.345s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:12:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:12:30 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b Jul 18 06:12:30 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:12:31 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1b5a9e30-40c5-4279-b9c9-a3eea074385b" returned: 0 in 0.250s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "cinder-quobyte-1b5a9e30-40c5-4279-b9c9-a3eea074385b" released by "delete_volume" :: held 0.634s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Created reservations ['3251edb7-4d52-455a-9ab9-9ca734827e9a', '44bc7be7-5f86-445b-a4ad-87ab0bf96dda', 'b9c3ba53-6257-48ec-b3f9-e0d148f68036', '8123d6ab-ad3d-495f-9dfe-097a8f9be806'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:12:31 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:12:31 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:12:31 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:12:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Deleted volume successfully. Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3f71cad4-6c08-4fd6-8e3b-49945651dca6 tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "cinder-1b5a9e30-40c5-4279-b9c9-a3eea074385b-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Acquiring lock "cinder-c99eb385-0e5b-43d3-b432-e85677aa2a9c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "cinder-c99eb385-0e5b-43d3-b432-e85677aa2a9c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Acquiring lock "cinder-quobyte-c99eb385-0e5b-43d3-b432-e85677aa2a9c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "cinder-quobyte-c99eb385-0e5b-43d3-b432-e85677aa2a9c" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c864d7-dc29-4f1d-90af-03a365d66aad]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:12:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:12:31 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c Jul 18 06:12:31 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:12:32 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:12:32 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c Jul 18 06:12:32 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:12:32 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c99eb385-0e5b-43d3-b432-e85677aa2a9c" returned: 0 in 0.235s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "cinder-quobyte-c99eb385-0e5b-43d3-b432-e85677aa2a9c" released by "delete_volume" :: held 0.639s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Created reservations ['c674d0c9-e893-4348-a34d-e73816de3806', 'cb73edc5-5313-408b-85a6-ca9c36f4da16', '799fafcc-1ebd-4c5e-aa76-ff7a65f69706', '72befafe-8f53-481a-bb90-360bc7a269f9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:12:32 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:12:32 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:12:32 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.241s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:12:32 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Deleted volume successfully. Jul 18 06:12:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0530ed17-1a6b-4979-97a4-bda4a5a6af7a tempest-TestServerVolumeAttachmentScenario-1420137008 None] Lock "cinder-c99eb385-0e5b-43d3-b432-e85677aa2a9c-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:12:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:12:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:12:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:12:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:12:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:12:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:12:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:12:35 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:12:35 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:12:35 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Jul 18 06:12:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:12:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:12:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:12:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:12:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:12:42 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=28,cinder:UPDATE=19,cinder:INSERT=3 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:12:42 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=22,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:12:55 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:12:55 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:13:03 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:13:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Flow 'volume_create_manager' (8e55a1c2-8e5e-4a6d-b09e-dbe8e6a2f43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:13:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625e43a6-6971-464e-aa45-e85453326cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:13:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625e43a6-6971-464e-aa45-e85453326cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-43163199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e41a10-e384-4bdc-9e73-ba38f88b175b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2f2af26a0844d0a8235c34ff42ff8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:13:04Z,use_quota=True,user_id='4144864d50fb47afb08b60953f2ce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:13:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ae2073-1db7-4520-bb34-85ee31b7a7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:13:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51ae2073-1db7-4520-bb34-85ee31b7a7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:13:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d72eee-327c-432c-9f8b-13bc82cd8731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:13:03 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 06:13:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d72eee-327c-432c-9f8b-13bc82cd8731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06e41a10-e384-4bdc-9e73-ba38f88b175b', 'volume_name': 'volume-06e41a10-e384-4bdc-9e73-ba38f88b175b', 'volume_size': 1, 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56cf243eadf74e53add363d5f7382182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'created_at': datetime.datetime(2026, 7, 18, 3, 51, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 51, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:13:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8c791b-3b09-456a-a405-ad6921993da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:13:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8c791b-3b09-456a-a405-ad6921993da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:13:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f58262-0f94-42c5-88e9-e694d3663b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:13:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Volume 06e41a10-e384-4bdc-9e73-ba38f88b175b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06e41a10-e384-4bdc-9e73-ba38f88b175b', 'volume_size': 1, 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56cf243eadf74e53add363d5f7382182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'created_at': datetime.datetime(2026, 7, 18, 3, 51, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 51, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 18 06:13:04 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Trying to clone 06e41a10-e384-4bdc-9e73-ba38f88b175b from image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 06:13:04 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 06:13:04 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Image download 20.69 MB at 20.69 MB/s Jul 18 06:13:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2032095f-0ed6-462c-8314-8df02384a43d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:13:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:13:04 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD Jul 18 06:13:04 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:13:04 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Jul 18 06:13:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:13:04 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Temporary image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a is fetched for user 4144864d50fb47afb08b60953f2ce55e. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 06:13:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22b668c-1a76-4457-b514-1ee495340299]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:13:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:13:04 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD Jul 18 06:13:04 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:13:05 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD" returned: 0 in 0.314s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-43163199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06e41a10-e384-4bdc-9e73-ba38f88b175b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2f2af26a0844d0a8235c34ff42ff8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:13:04Z,use_quota=True,user_id='4144864d50fb47afb08b60953f2ce55e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Creating volume 06e41a10-e384-4bdc-9e73-ba38f88b175b {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:13:05 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:13:05 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b 1073741824 Jul 18 06:13:05 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:13:05 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b 1073741824" returned: 0 in 0.433s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:13:05 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b Jul 18 06:13:05 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:13:05 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:13:05 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Attempting download of b5dcfdae-2c52-436e-9a7d-1ba63c90db8a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}])) to volume 06e41a10-e384-4bdc-9e73-ba38f88b175b. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 06:13:06 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7c0851-a824-466d-9c70-a09d06abafaf]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:13:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_emllm3ql {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:13:06 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_emllm3ql Jul 18 06:13:06 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:13:06 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jul 18 06:13:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_emllm3ql" returned: 0 in 0.337s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:13:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_emllm3ql {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:13:06 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_emllm3ql Jul 18 06:13:06 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:13:06 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Jul 18 06:13:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_emllm3ql" returned: 1 in 0.313s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:13:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_emllm3ql' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:13:06 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb8a227-6d49-4c43-8e3c-a0ed9254f647]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:13:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:13:06 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD Jul 18 06:13:06 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:13:06 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Jul 18 06:13:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:13:06 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] b5dcfdae-2c52-436e-9a7d-1ba63c90db8a was qcow2, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 06:13:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:13:07 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b Jul 18 06:13:07 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:13:08 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b" returned: 0 in 1.531s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5dcfdae-2c52-436e-9a7d-1ba63c90db8a_9o3ct0b5devstack@QuobyteHD, size 112.00 MB, duration 1.53 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:13:08 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Converted 112.00 MB image at 73.11 MB/s Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:13:08 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b 1G Jul 18 06:13:08 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:13:08 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b 1G" returned: 0 in 0.302s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Downloaded image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a ((None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}])) to volume 06e41a10-e384-4bdc-9e73-ba38f88b175b successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Temporary image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a for user 4144864d50fb47afb08b60953f2ce55e is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Marking volume 06e41a10-e384-4bdc-9e73-ba38f88b175b as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Copying metadata from image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a to 06e41a10-e384-4bdc-9e73-ba38f88b175b. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Creating volume glance metadata for volume 06e41a10-e384-4bdc-9e73-ba38f88b175b backed by image b5dcfdae-2c52-436e-9a7d-1ba63c90db8a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f58262-0f94-42c5-88e9-e694d3663b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e41a10-e384-4bdc-9e73-ba38f88b175b', 'volume_size': 1, 'image_id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '56cf243eadf74e53add363d5f7382182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b5dcfdae-2c52-436e-9a7d-1ba63c90db8a', 'created_at': datetime.datetime(2026, 7, 18, 3, 51, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 3, 51, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5dcfdae-2c52-436e-9a7d-1ba63c90db8a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97731301-150f-4f21-bf9e-4cf020042943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:13:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Volume volume-06e41a10-e384-4bdc-9e73-ba38f88b175b (06e41a10-e384-4bdc-9e73-ba38f88b175b): created successfully Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97731301-150f-4f21-bf9e-4cf020042943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:13:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Flow 'volume_create_manager' (8e55a1c2-8e5e-4a6d-b09e-dbe8e6a2f43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:13:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-57a5dde6-183b-4f96-b40b-66a4672cc8cb tempest-TestShelveInstance-342161215 None] Created volume successfully. Jul 18 06:13:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-42455a9c-7169-4990-859f-80e1110129a6 req-a65a0956-3190-4542-bb08-78859d13916d tempest-TestShelveInstance-342161215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:13:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-42455a9c-7169-4990-859f-80e1110129a6 req-a65a0956-3190-4542-bb08-78859d13916d tempest-TestShelveInstance-342161215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:13:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-42455a9c-7169-4990-859f-80e1110129a6 req-a65a0956-3190-4542-bb08-78859d13916d tempest-TestShelveInstance-342161215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:13:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-42455a9c-7169-4990-859f-80e1110129a6 req-a65a0956-3190-4542-bb08-78859d13916d tempest-TestShelveInstance-342161215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-06e41a10-e384-4bdc-9e73-ba38f88b175b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '426a2511-0b9c-4ac4-8007-f93bf87ee90f', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:13:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-42455a9c-7169-4990-859f-80e1110129a6 req-a65a0956-3190-4542-bb08-78859d13916d tempest-TestShelveInstance-342161215 None] attachment_update completed successfully. Jul 18 06:13:22 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=5 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:13:22 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=18,cinder:UPDATE=7,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:13:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:13:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:13:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:13:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:13:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:13:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:13:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:13:35 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:13:35 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:13:35 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Jul 18 06:13:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.249s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:13:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:13:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:13:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:13:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:13:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-644c820d-5b19-48f7-a269-d84923b861a7 req-c608b40d-499a-4b4b-838c-09538ec28cab tempest-TestShelveInstance-342161215 None] Terminate volume connection completed successfully. Jul 18 06:13:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-644c820d-5b19-48f7-a269-d84923b861a7 req-c608b40d-499a-4b4b-838c-09538ec28cab tempest-TestShelveInstance-342161215 None] Deleting attachment 426a2511-0b9c-4ac4-8007-f93bf87ee90f. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:13:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3070aee1-1e08-47c6-95a4-0a33b1441779 req-6304962c-f374-4bff-af51-1cd75c4bc361 tempest-TestShelveInstance-342161215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:13:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3070aee1-1e08-47c6-95a4-0a33b1441779 req-6304962c-f374-4bff-af51-1cd75c4bc361 tempest-TestShelveInstance-342161215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:13:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-3070aee1-1e08-47c6-95a4-0a33b1441779 req-6304962c-f374-4bff-af51-1cd75c4bc361 tempest-TestShelveInstance-342161215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:13:46 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-3070aee1-1e08-47c6-95a4-0a33b1441779 req-6304962c-f374-4bff-af51-1cd75c4bc361 tempest-TestShelveInstance-342161215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d', 'name': 'volume-06e41a10-e384-4bdc-9e73-ba38f88b175b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5dce4b6-4891-4a66-bc1b-689aeccb7bb0', 'enforce_multipath': True} {{(pid=87750) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 18 06:13:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-3070aee1-1e08-47c6-95a4-0a33b1441779 req-6304962c-f374-4bff-af51-1cd75c4bc361 tempest-TestShelveInstance-342161215 None] attachment_update completed successfully. Jul 18 06:13:56 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:13:56 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:14:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-6b312af6-dbc0-4aec-ad24-7cc6a1b618a5 tempest-TestShelveInstance-342161215 None] Terminate volume connection completed successfully. Jul 18 06:14:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-6b312af6-dbc0-4aec-ad24-7cc6a1b618a5 tempest-TestShelveInstance-342161215 None] Deleting attachment e5dce4b6-4891-4a66-bc1b-689aeccb7bb0. {{(pid=87750) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 18 06:14:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Acquiring lock "cinder-06e41a10-e384-4bdc-9e73-ba38f88b175b-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Lock "cinder-06e41a10-e384-4bdc-9e73-ba38f88b175b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Acquiring lock "cinder-quobyte-06e41a10-e384-4bdc-9e73-ba38f88b175b" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Lock "cinder-quobyte-06e41a10-e384-4bdc-9e73-ba38f88b175b" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fd3a72-7639-40bb-a509-b7a49a95a1ad]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:14:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:14 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b Jul 18 06:14:14 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:15 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b" returned: 0 in 0.407s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:15 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b Jul 18 06:14:15 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:15 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-06e41a10-e384-4bdc-9e73-ba38f88b175b" returned: 0 in 0.252s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Lock "cinder-quobyte-06e41a10-e384-4bdc-9e73-ba38f88b175b" released by "delete_volume" :: held 0.701s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG cinder.quota [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Created reservations ['8fac6d7c-06a2-4884-b70b-db126beb5521', '254c8dbe-2b4f-4880-ac04-3f87bc9c1910', 'd9f4bb21-3264-462e-952f-4d82d82a3caf', '251398d0-e783-4a84-8af6-2be4db91ceb4'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:15 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:14:15 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:15 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG cinder.manager [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:14:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Deleted volume successfully. Jul 18 06:14:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [req-38ed7021-48ba-4423-b3e3-795c2fa455bd req-627d4a05-25fd-4061-a288-9e889449f0f9 tempest-TestShelveInstance-342161215 None] Lock "cinder-06e41a10-e384-4bdc-9e73-ba38f88b175b-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:25 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:14:25 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Flow 'volume_create_manager' (72cfdc3d-b525-40b6-980d-280ed19c649b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec7ca19-d193-4ece-8f98-360a888f8c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec7ca19-d193-4ece-8f98-360a888f8c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f85a23b-7e79-4ec1-86b3-da406875d796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d2f57997d04b97a69653c7237cfe5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:30Z,use_quota=True,user_id='4b3f3380bd3a4e83830fe87353fa8899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c0c7cf4-85c6-4666-99c5-9d1dfe9a8300),volume_type_id=5c0c7cf4-85c6-4666-99c5-9d1dfe9a8300)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cee4561-9248-4ff7-98f7-b4f4fdac1142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cee4561-9248-4ff7-98f7-b4f4fdac1142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94d986a-b58d-4d8d-aa34-876c692b719b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94d986a-b58d-4d8d-aa34-876c692b719b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f85a23b-7e79-4ec1-86b3-da406875d796', 'volume_name': 'volume-8f85a23b-7e79-4ec1-86b3-da406875d796', 'volume_size': 1, 'image_id': '3d026cf2-f3f6-438d-8d50-b741a5373dec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d026cf2-f3f6-438d-8d50-b741a5373dec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd207fbc26ed4835b10c8bc3df0cbf3e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60d2f57997d04b97a69653c7237cfe5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82de85b0f348ac4cd9010986e5adaeeaa0586156b5f012678984d7a274e0a3e675a15083a09873331ef50350eea7c2845ee3a80aafd212c6202b8bd53499fdcb', 'id': '3d026cf2-f3f6-438d-8d50-b741a5373dec', 'created_at': datetime.datetime(2026, 7, 18, 4, 14, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 14, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d026cf2-f3f6-438d-8d50-b741a5373dec/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76542982-c240-40a9-a4f4-590af93ede1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76542982-c240-40a9-a4f4-590af93ede1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e7595f-4952-4936-8db3-663b9da2b74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:30 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Volume 8f85a23b-7e79-4ec1-86b3-da406875d796: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f85a23b-7e79-4ec1-86b3-da406875d796', 'volume_size': 1, 'image_id': '3d026cf2-f3f6-438d-8d50-b741a5373dec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d026cf2-f3f6-438d-8d50-b741a5373dec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd207fbc26ed4835b10c8bc3df0cbf3e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60d2f57997d04b97a69653c7237cfe5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82de85b0f348ac4cd9010986e5adaeeaa0586156b5f012678984d7a274e0a3e675a15083a09873331ef50350eea7c2845ee3a80aafd212c6202b8bd53499fdcb', 'id': '3d026cf2-f3f6-438d-8d50-b741a5373dec', 'created_at': datetime.datetime(2026, 7, 18, 4, 14, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 14, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d026cf2-f3f6-438d-8d50-b741a5373dec/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Trying to clone 8f85a23b-7e79-4ec1-86b3-da406875d796 from image 3d026cf2-f3f6-438d-8d50-b741a5373dec at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d026cf2-f3f6-438d-8d50-b741a5373dec', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 06:14:30 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Image download 0.00 MB at 0.00 MB/s Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[963d0225-5235-414e-9281-118fa9533404]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:14:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:30 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD Jul 18 06:14:30 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:31 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:31 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD Jul 18 06:14:31 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:31 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:14:31 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Temporary image 3d026cf2-f3f6-438d-8d50-b741a5373dec is fetched for user 4b3f3380bd3a4e83830fe87353fa8899. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 06:14:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4f88f8-0732-4195-97ae-3c646f92ca2e]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:14:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:31 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD Jul 18 06:14:31 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:31 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:31 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD Jul 18 06:14:31 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:32 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f85a23b-7e79-4ec1-86b3-da406875d796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d2f57997d04b97a69653c7237cfe5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:30Z,use_quota=True,user_id='4b3f3380bd3a4e83830fe87353fa8899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c0c7cf4-85c6-4666-99c5-9d1dfe9a8300),volume_type_id=5c0c7cf4-85c6-4666-99c5-9d1dfe9a8300)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Creating volume 8f85a23b-7e79-4ec1-86b3-da406875d796 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:14:32 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:32 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 1073741824 Jul 18 06:14:32 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:32 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 1073741824" returned: 0 in 0.397s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:32 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 Jul 18 06:14:32 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:32 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796" returned: 0 in 0.229s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Attempting download of 3d026cf2-f3f6-438d-8d50-b741a5373dec ((None, [{'url': 'file:///opt/stack/data/glance/images/3d026cf2-f3f6-438d-8d50-b741a5373dec', 'metadata': {}}])) to volume 8f85a23b-7e79-4ec1-86b3-da406875d796. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5548aa12-246d-4d9b-b95d-5c0cf2c8b67b]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:14:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d026cf2-f3f6-438d-8d50-b741a5373dec_s82sg4lm {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:32 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d026cf2-f3f6-438d-8d50-b741a5373dec_s82sg4lm Jul 18 06:14:32 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:33 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d026cf2-f3f6-438d-8d50-b741a5373dec_s82sg4lm" returned: 0 in 0.319s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d026cf2-f3f6-438d-8d50-b741a5373dec_s82sg4lm {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:33 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d026cf2-f3f6-438d-8d50-b741a5373dec_s82sg4lm Jul 18 06:14:33 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:33 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d026cf2-f3f6-438d-8d50-b741a5373dec_s82sg4lm" returned: 1 in 0.315s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d026cf2-f3f6-438d-8d50-b741a5373dec_s82sg4lm' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:14:33 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[139cf6b2-7664-41a6-ac5f-347bf46ae805]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:14:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:33 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD Jul 18 06:14:33 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:33 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:33 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD Jul 18 06:14:33 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:34 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] 3d026cf2-f3f6-438d-8d50-b741a5373dec was raw, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:34 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 Jul 18 06:14:34 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:34 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796" returned: 0 in 0.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d026cf2-f3f6-438d-8d50-b741a5373dec_rohhgqrudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:14:34 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Converted 0.00 MB image at 0.00 MB/s Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:34 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 1G Jul 18 06:14:34 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:34 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 1G" returned: 0 in 0.289s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Downloaded image 3d026cf2-f3f6-438d-8d50-b741a5373dec ((None, [{'url': 'file:///opt/stack/data/glance/images/3d026cf2-f3f6-438d-8d50-b741a5373dec', 'metadata': {}}])) to volume 8f85a23b-7e79-4ec1-86b3-da406875d796 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Temporary image 3d026cf2-f3f6-438d-8d50-b741a5373dec for user 4b3f3380bd3a4e83830fe87353fa8899 is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Marking volume 8f85a23b-7e79-4ec1-86b3-da406875d796 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Copying metadata from image 3d026cf2-f3f6-438d-8d50-b741a5373dec to 8f85a23b-7e79-4ec1-86b3-da406875d796. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Creating volume glance metadata for volume 8f85a23b-7e79-4ec1-86b3-da406875d796 backed by image 3d026cf2-f3f6-438d-8d50-b741a5373dec with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3d026cf2-f3f6-438d-8d50-b741a5373dec', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd207fbc26ed4835b10c8bc3df0cbf3e8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e7595f-4952-4936-8db3-663b9da2b74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f85a23b-7e79-4ec1-86b3-da406875d796', 'volume_size': 1, 'image_id': '3d026cf2-f3f6-438d-8d50-b741a5373dec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d026cf2-f3f6-438d-8d50-b741a5373dec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd207fbc26ed4835b10c8bc3df0cbf3e8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60d2f57997d04b97a69653c7237cfe5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '82de85b0f348ac4cd9010986e5adaeeaa0586156b5f012678984d7a274e0a3e675a15083a09873331ef50350eea7c2845ee3a80aafd212c6202b8bd53499fdcb', 'id': '3d026cf2-f3f6-438d-8d50-b741a5373dec', 'created_at': datetime.datetime(2026, 7, 18, 4, 14, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 14, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d026cf2-f3f6-438d-8d50-b741a5373dec/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713a9f37-152e-4ce9-8b9e-094f7098ec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Volume volume-8f85a23b-7e79-4ec1-86b3-da406875d796 (8f85a23b-7e79-4ec1-86b3-da406875d796): created successfully Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713a9f37-152e-4ce9-8b9e-094f7098ec67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Flow 'volume_create_manager' (72cfdc3d-b525-40b6-980d-280ed19c649b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-03af3503-4f1e-49bc-8ae5-d77474115a1f tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Created volume successfully. Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:35 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:14:35 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:35 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.236s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Acquiring lock "cinder-8f85a23b-7e79-4ec1-86b3-da406875d796-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Lock "cinder-8f85a23b-7e79-4ec1-86b3-da406875d796-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Acquiring lock "cinder-quobyte-8f85a23b-7e79-4ec1-86b3-da406875d796" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Lock "cinder-quobyte-8f85a23b-7e79-4ec1-86b3-da406875d796" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b8f662-8c67-443c-9fa4-9e111e957688]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:14:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:35 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 Jul 18 06:14:35 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:36 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:36 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796 Jul 18 06:14:36 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:36 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8f85a23b-7e79-4ec1-86b3-da406875d796" returned: 0 in 0.245s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Lock "cinder-quobyte-8f85a23b-7e79-4ec1-86b3-da406875d796" released by "delete_volume" :: held 0.622s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:36 devstack cinder-volume[87750]: WARNING cinder.quota [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:14:36 devstack cinder-volume[87750]: WARNING cinder.quota [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Created reservations ['086ef7a7-b296-4d03-be4a-dd8878af8568', '7a5765f3-8506-416f-8a87-7d742a19e1fa', '0d73a338-86c5-482e-b50e-227eb64295ea', 'ae1a2028-5ae6-410b-8d2a-e292b92bf855'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:36 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:14:36 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:36 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:14:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Deleted volume successfully. Jul 18 06:14:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b526ece4-5878-4709-8c67-53a332e99150 tempest-VolumeAndVolumeTypeFromImageTest-1829346765 None] Lock "cinder-8f85a23b-7e79-4ec1-86b3-da406875d796-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Flow 'volume_create_manager' (cc2d411e-6e59-4281-a32f-2d669c611b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8f96c9-1c8c-4da7-a632-e53293e749c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8f96c9-1c8c-4da7-a632-e53293e749c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1588912407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5eb22afb424925bd70376571bb0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:41Z,use_quota=True,user_id='9ca8cb4936ee448db20363f825576504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ffa91d-04df-4252-becf-eedde902b838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ffa91d-04df-4252-becf-eedde902b838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3d5079-a657-4c9a-b484-de3fdbccea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3d5079-a657-4c9a-b484-de3fdbccea3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6', 'volume_name': 'volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee85368-4a76-4020-bf37-cd61f2a13288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee85368-4a76-4020-bf37-cd61f2a13288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de0de7f-d47b-42c5-a466-7051c5bc8b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Volume bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6', 'volume_size': 1} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1588912407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5eb22afb424925bd70376571bb0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:41Z,use_quota=True,user_id='9ca8cb4936ee448db20363f825576504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Creating volume bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:14:40 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:14:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:40 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6 1073741824 Jul 18 06:14:40 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Flow 'volume_create_manager' (d382ce3b-2ecd-4618-bdd3-4ad0f379f050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a72faf-b26c-4afb-86fa-abb9da4020a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a72faf-b26c-4afb-86fa-abb9da4020a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1384623428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4493251-838d-4990-bcce-803ebb08e79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5eb22afb424925bd70376571bb0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:41Z,use_quota=True,user_id='9ca8cb4936ee448db20363f825576504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e248fe0c-2304-4f79-90b9-b77c87d9f9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e248fe0c-2304-4f79-90b9-b77c87d9f9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5943ab-5959-4d11-b03a-a1601cc95f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5943ab-5959-4d11-b03a-a1601cc95f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4493251-838d-4990-bcce-803ebb08e79d', 'volume_name': 'volume-b4493251-838d-4990-bcce-803ebb08e79d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74cb0a0b-9c27-49a3-9793-aee47c4f0424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74cb0a0b-9c27-49a3-9793-aee47c4f0424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbac82d6-612a-4b4e-8615-2600d6ef430d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Volume b4493251-838d-4990-bcce-803ebb08e79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4493251-838d-4990-bcce-803ebb08e79d', 'volume_size': 1} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:41 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6 1073741824" returned: 0 in 0.471s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:41 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6 Jul 18 06:14:41 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Flow 'volume_create_manager' (460cb5c5-d7ac-4ec4-aff6-60949368f97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98846b4e-81ed-404f-866c-856fb90640db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98846b4e-81ed-404f-866c-856fb90640db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-672040953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4de0e65-7400-4867-90c6-e1ee5200c93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5eb22afb424925bd70376571bb0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:41Z,use_quota=True,user_id='9ca8cb4936ee448db20363f825576504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c695c8b-896b-4629-bb54-752f1f024853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c695c8b-896b-4629-bb54-752f1f024853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55eea59-504c-4846-a6fb-1f66280c6e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55eea59-504c-4846-a6fb-1f66280c6e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4de0e65-7400-4867-90c6-e1ee5200c93d', 'volume_name': 'volume-a4de0e65-7400-4867-90c6-e1ee5200c93d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028d66b8-7f62-4f48-8c60-d08c7db55dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028d66b8-7f62-4f48-8c60-d08c7db55dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c2c76a-aaa4-4d88-9fc3-b15095c414b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Volume a4de0e65-7400-4867-90c6-e1ee5200c93d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4de0e65-7400-4867-90c6-e1ee5200c93d', 'volume_size': 1} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:41 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.465s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1384623428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4493251-838d-4990-bcce-803ebb08e79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5eb22afb424925bd70376571bb0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:41Z,use_quota=True,user_id='9ca8cb4936ee448db20363f825576504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Creating volume b4493251-838d-4990-bcce-803ebb08e79d {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:14:41 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b4493251-838d-4990-bcce-803ebb08e79d 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de0de7f-d47b-42c5-a466-7051c5bc8b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578f6040-753d-42f6-87f1-78c053f96c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b4493251-838d-4990-bcce-803ebb08e79d 1073741824 Jul 18 06:14:41 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Volume volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6 (bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6): created successfully Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578f6040-753d-42f6-87f1-78c053f96c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Flow 'volume_create_manager' (cc2d411e-6e59-4281-a32f-2d669c611b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e70351ea-362e-4fb9-b279-eb4c4a5d913c tempest-CreateVolumesFromImageTest-1133734239 None] Created volume successfully. Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Flow 'volume_create_manager' (7074c5b6-fd96-44d3-9238-108e0f8806af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e85b9c2-2606-431e-b24f-f388cc321f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e85b9c2-2606-431e-b24f-f388cc321f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1537217843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37575b99-1877-4eee-afa4-2d441f8e7d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5eb22afb424925bd70376571bb0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:42Z,use_quota=True,user_id='9ca8cb4936ee448db20363f825576504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca22edd0-d8a6-47f2-81a4-2ab17944f82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca22edd0-d8a6-47f2-81a4-2ab17944f82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4ab292-2ac8-4dba-92de-612345cb2fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4ab292-2ac8-4dba-92de-612345cb2fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37575b99-1877-4eee-afa4-2d441f8e7d6a', 'volume_name': 'volume-37575b99-1877-4eee-afa4-2d441f8e7d6a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a595f37a-7c9d-4ff0-a2f4-7e0163953796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a595f37a-7c9d-4ff0-a2f4-7e0163953796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbf292a-4887-4874-b451-a993b709a447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Volume 37575b99-1877-4eee-afa4-2d441f8e7d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37575b99-1877-4eee-afa4-2d441f8e7d6a', 'volume_size': 1} Jul 18 06:14:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:42 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b4493251-838d-4990-bcce-803ebb08e79d 1073741824" returned: 0 in 0.574s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Flow 'volume_create_manager' (12dc1d8e-e079-40e3-9e89-189ce8570f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c7c7d0-5a63-453e-aaa2-188e94dafe84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b4493251-838d-4990-bcce-803ebb08e79d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:42 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b4493251-838d-4990-bcce-803ebb08e79d Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c7c7d0-5a63-453e-aaa2-188e94dafe84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1006986110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e57e895-85e1-4916-b09c-1ede521eb106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5eb22afb424925bd70376571bb0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:42Z,use_quota=True,user_id='9ca8cb4936ee448db20363f825576504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:42 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a1f938-d7d2-41cc-84ec-abf633ae291c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a1f938-d7d2-41cc-84ec-abf633ae291c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7f8ae9-3f08-4b49-ac2a-2f484bbbc3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7f8ae9-3f08-4b49-ac2a-2f484bbbc3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e57e895-85e1-4916-b09c-1ede521eb106', 'volume_name': 'volume-6e57e895-85e1-4916-b09c-1ede521eb106', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dfcc029-a144-4a1d-88bf-7f7177b7726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dfcc029-a144-4a1d-88bf-7f7177b7726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cc77bc-eba5-4a00-919a-2451b9eaf5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:42 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Volume 6e57e895-85e1-4916-b09c-1ede521eb106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e57e895-85e1-4916-b09c-1ede521eb106', 'volume_size': 1} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:42 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b4493251-838d-4990-bcce-803ebb08e79d" returned: 0 in 0.247s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.966s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-672040953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4de0e65-7400-4867-90c6-e1ee5200c93d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5eb22afb424925bd70376571bb0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:41Z,use_quota=True,user_id='9ca8cb4936ee448db20363f825576504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Creating volume a4de0e65-7400-4867-90c6-e1ee5200c93d {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:14:42 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a4de0e65-7400-4867-90c6-e1ee5200c93d 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbac82d6-612a-4b4e-8615-2600d6ef430d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4493251-838d-4990-bcce-803ebb08e79d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:42 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a4de0e65-7400-4867-90c6-e1ee5200c93d 1073741824 Jul 18 06:14:42 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583f2474-8300-4cff-bb95-696cb6ca54f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:42 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Volume volume-b4493251-838d-4990-bcce-803ebb08e79d (b4493251-838d-4990-bcce-803ebb08e79d): created successfully Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583f2474-8300-4cff-bb95-696cb6ca54f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Flow 'volume_create_manager' (d382ce3b-2ecd-4618-bdd3-4ad0f379f050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:42 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-dd389aad-2ac2-4ae9-b635-834fbf0f711c tempest-CreateVolumesFromImageTest-1133734239 None] Created volume successfully. Jul 18 06:14:42 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a4de0e65-7400-4867-90c6-e1ee5200c93d 1073741824" returned: 0 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a4de0e65-7400-4867-90c6-e1ee5200c93d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:42 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a4de0e65-7400-4867-90c6-e1ee5200c93d Jul 18 06:14:42 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:43 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a4de0e65-7400-4867-90c6-e1ee5200c93d" returned: 0 in 0.233s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.309s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1537217843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37575b99-1877-4eee-afa4-2d441f8e7d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5eb22afb424925bd70376571bb0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:42Z,use_quota=True,user_id='9ca8cb4936ee448db20363f825576504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Creating volume 37575b99-1877-4eee-afa4-2d441f8e7d6a {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:14:43 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-37575b99-1877-4eee-afa4-2d441f8e7d6a 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c2c76a-aaa4-4d88-9fc3-b15095c414b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4de0e65-7400-4867-90c6-e1ee5200c93d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:43 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-37575b99-1877-4eee-afa4-2d441f8e7d6a 1073741824 Jul 18 06:14:43 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f72fb41-c2e0-4367-a946-492a6521c499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Volume volume-a4de0e65-7400-4867-90c6-e1ee5200c93d (a4de0e65-7400-4867-90c6-e1ee5200c93d): created successfully Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f72fb41-c2e0-4367-a946-492a6521c499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Flow 'volume_create_manager' (460cb5c5-d7ac-4ec4-aff6-60949368f97c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-892edec7-8e9b-4b02-b679-c0af3636dc68 tempest-CreateVolumesFromImageTest-1133734239 None] Created volume successfully. Jul 18 06:14:43 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-37575b99-1877-4eee-afa4-2d441f8e7d6a 1073741824" returned: 0 in 0.408s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-37575b99-1877-4eee-afa4-2d441f8e7d6a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:43 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-37575b99-1877-4eee-afa4-2d441f8e7d6a Jul 18 06:14:43 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:43 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-37575b99-1877-4eee-afa4-2d441f8e7d6a" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1006986110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e57e895-85e1-4916-b09c-1ede521eb106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a5eb22afb424925bd70376571bb0955',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:42Z,use_quota=True,user_id='9ca8cb4936ee448db20363f825576504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Creating volume 6e57e895-85e1-4916-b09c-1ede521eb106 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:14:43 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6e57e895-85e1-4916-b09c-1ede521eb106 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbf292a-4887-4874-b451-a993b709a447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37575b99-1877-4eee-afa4-2d441f8e7d6a', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:43 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6e57e895-85e1-4916-b09c-1ede521eb106 1073741824 Jul 18 06:14:43 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb9aeb4-8010-455d-85dc-cac730dad893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Volume volume-37575b99-1877-4eee-afa4-2d441f8e7d6a (37575b99-1877-4eee-afa4-2d441f8e7d6a): created successfully Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb9aeb4-8010-455d-85dc-cac730dad893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Flow 'volume_create_manager' (7074c5b6-fd96-44d3-9238-108e0f8806af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-19b9ab46-3d5e-4763-8b7c-bf0dc11f4613 tempest-CreateVolumesFromImageTest-1133734239 None] Created volume successfully. Jul 18 06:14:44 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6e57e895-85e1-4916-b09c-1ede521eb106 1073741824" returned: 0 in 0.451s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6e57e895-85e1-4916-b09c-1ede521eb106 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:44 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6e57e895-85e1-4916-b09c-1ede521eb106 Jul 18 06:14:44 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:44 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6e57e895-85e1-4916-b09c-1ede521eb106" returned: 0 in 0.277s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:14:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cc77bc-eba5-4a00-919a-2451b9eaf5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e57e895-85e1-4916-b09c-1ede521eb106', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d725fcd-8394-436a-a32f-da6a2aedf733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:44 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Volume volume-6e57e895-85e1-4916-b09c-1ede521eb106 (6e57e895-85e1-4916-b09c-1ede521eb106): created successfully Jul 18 06:14:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d725fcd-8394-436a-a32f-da6a2aedf733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Flow 'volume_create_manager' (12dc1d8e-e079-40e3-9e89-189ce8570f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-31c37bd2-f80b-4822-a31a-3ff178557ac7 tempest-CreateVolumesFromImageTest-1133734239 None] Created volume successfully. Jul 18 06:14:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "cinder-6e57e895-85e1-4916-b09c-1ede521eb106-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-6e57e895-85e1-4916-b09c-1ede521eb106-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "cinder-quobyte-6e57e895-85e1-4916-b09c-1ede521eb106" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-quobyte-6e57e895-85e1-4916-b09c-1ede521eb106" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aece6d4-66e1-4744-9fb3-2af4c542cdaa]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:14:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6e57e895-85e1-4916-b09c-1ede521eb106 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:45 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6e57e895-85e1-4916-b09c-1ede521eb106 Jul 18 06:14:45 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:45 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6e57e895-85e1-4916-b09c-1ede521eb106" returned: 0 in 0.351s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6e57e895-85e1-4916-b09c-1ede521eb106 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:45 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6e57e895-85e1-4916-b09c-1ede521eb106 Jul 18 06:14:45 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:46 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6e57e895-85e1-4916-b09c-1ede521eb106" returned: 0 in 0.246s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-quobyte-6e57e895-85e1-4916-b09c-1ede521eb106" released by "delete_volume" :: held 0.635s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Created reservations ['6e5b32bb-1fca-4d1d-acf7-6c095ce10a45', 'ba38fd27-ccdb-4a69-83b0-b48cf10f9b31', 'f408ec04-b02d-4ff1-ae4a-da527e4e64d0', 'e83c312c-e69a-4f00-b97a-c280dba1c339'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:46 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:14:46 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:46 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:14:46 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Deleted volume successfully. Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-eb96de1e-cc2d-4959-89a2-d8b8137246f2 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-6e57e895-85e1-4916-b09c-1ede521eb106-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "cinder-37575b99-1877-4eee-afa4-2d441f8e7d6a-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-37575b99-1877-4eee-afa4-2d441f8e7d6a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "cinder-quobyte-37575b99-1877-4eee-afa4-2d441f8e7d6a" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-quobyte-37575b99-1877-4eee-afa4-2d441f8e7d6a" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de3bd74-78bb-4576-b673-4cb54d5e47fe]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:14:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-37575b99-1877-4eee-afa4-2d441f8e7d6a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:46 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-37575b99-1877-4eee-afa4-2d441f8e7d6a Jul 18 06:14:46 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:47 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-37575b99-1877-4eee-afa4-2d441f8e7d6a" returned: 0 in 0.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-37575b99-1877-4eee-afa4-2d441f8e7d6a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:47 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-37575b99-1877-4eee-afa4-2d441f8e7d6a Jul 18 06:14:47 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:47 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-37575b99-1877-4eee-afa4-2d441f8e7d6a" returned: 0 in 0.241s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-quobyte-37575b99-1877-4eee-afa4-2d441f8e7d6a" released by "delete_volume" :: held 0.637s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Created reservations ['18709a8b-b192-488d-90f4-0bc0dad66cc4', 'fcd5fd25-ad37-4067-baa3-6e7bd31bbe2f', '62e73863-c063-4cd4-a88c-ed3b28abbeb8', 'a4af2376-95e3-4e1a-a114-aa97a48e40d5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:47 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:14:47 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:47 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.234s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:14:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Deleted volume successfully. Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b05b5a9f-83ba-4f82-8849-25fff12451b7 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-37575b99-1877-4eee-afa4-2d441f8e7d6a-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "cinder-a4de0e65-7400-4867-90c6-e1ee5200c93d-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-a4de0e65-7400-4867-90c6-e1ee5200c93d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "cinder-quobyte-a4de0e65-7400-4867-90c6-e1ee5200c93d" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-quobyte-a4de0e65-7400-4867-90c6-e1ee5200c93d" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef80c5ea-9236-4d56-819c-04e93f5e96dc]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:14:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a4de0e65-7400-4867-90c6-e1ee5200c93d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:48 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a4de0e65-7400-4867-90c6-e1ee5200c93d Jul 18 06:14:48 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:48 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a4de0e65-7400-4867-90c6-e1ee5200c93d" returned: 0 in 0.354s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a4de0e65-7400-4867-90c6-e1ee5200c93d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:48 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a4de0e65-7400-4867-90c6-e1ee5200c93d Jul 18 06:14:48 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:48 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a4de0e65-7400-4867-90c6-e1ee5200c93d" returned: 0 in 0.252s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-quobyte-a4de0e65-7400-4867-90c6-e1ee5200c93d" released by "delete_volume" :: held 0.645s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Created reservations ['a4717bc8-ab05-4a8b-9592-a641f0288ec9', 'c56562ce-098d-4a75-8668-7d553e680a09', 'a3e228c9-072c-4fc0-bea8-606c7dd6a454', '2f00e7f2-396d-4ca4-a4e7-7fa8bfbba83a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:48 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:14:48 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:48 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.235s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:14:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Deleted volume successfully. Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-042b88c7-e85d-4246-8fdb-d82335911ae9 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-a4de0e65-7400-4867-90c6-e1ee5200c93d-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "cinder-b4493251-838d-4990-bcce-803ebb08e79d-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-b4493251-838d-4990-bcce-803ebb08e79d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "cinder-quobyte-b4493251-838d-4990-bcce-803ebb08e79d" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-quobyte-b4493251-838d-4990-bcce-803ebb08e79d" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b292fccc-4fbc-4e64-8ded-36ec33c197a3]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b4493251-838d-4990-bcce-803ebb08e79d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:49 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b4493251-838d-4990-bcce-803ebb08e79d Jul 18 06:14:49 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:49 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b4493251-838d-4990-bcce-803ebb08e79d" returned: 0 in 0.347s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b4493251-838d-4990-bcce-803ebb08e79d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:49 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b4493251-838d-4990-bcce-803ebb08e79d Jul 18 06:14:49 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:49 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b4493251-838d-4990-bcce-803ebb08e79d" returned: 0 in 0.245s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-quobyte-b4493251-838d-4990-bcce-803ebb08e79d" released by "delete_volume" :: held 0.632s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Created reservations ['da110419-a5a5-4423-b703-284a2a508581', '6033c987-9d99-4e4c-bed3-2a531fbf9273', '40fa0aa0-ce1d-4bb7-8863-2ddd41eea28c', '13cdfa86-62b5-4c47-8b8b-b1e55ee74471'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:49 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:14:49 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:50 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.241s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:50 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:14:50 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Deleted volume successfully. Jul 18 06:14:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-477bbb10-0178-4054-a454-d6980cc0133e tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-b4493251-838d-4990-bcce-803ebb08e79d-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "cinder-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "cinder-quobyte-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:14:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-quobyte-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:14:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e28604f-3e68-457f-aa36-476779de4e27]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:14:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:50 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6 Jul 18 06:14:50 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:50 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:50 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6 Jul 18 06:14:50 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:51 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-quobyte-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6" released by "delete_volume" :: held 0.621s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:51 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Created reservations ['69b82f18-a27b-4be3-bc7f-fd35b987db85', 'f8060e28-46f6-42da-a2af-4f6001c3975b', 'a6c5fdaf-cbc3-4e49-9070-016bcc3a71d8', 'fb4ce9f8-3279-4557-b1c9-5e6f7453c4d7'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:14:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:51 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:14:51 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:51 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:51 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:14:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Deleted volume successfully. Jul 18 06:14:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c56d4cf6-1b5a-4f54-b18a-81a87fea3443 tempest-CreateVolumesFromImageTest-1133734239 None] Lock "cinder-bbe7ef1d-afbd-4e97-bcf6-a8cd968c89c6-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Flow 'volume_create_manager' (2813e401-64cc-4271-b455-879a3468f7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b74d708-80a2-4780-a1ae-3d9d5d888460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b74d708-80a2-4780-a1ae-3d9d5d888460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279120953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d7f319-3821-4742-9ab8-a2ad1d212146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82ed0a00c984dde8d12f75c67f9f7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:54Z,use_quota=True,user_id='dcd8e9421d8947788140c9a19daf608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c92ab3-9253-4978-8790-272491115280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c92ab3-9253-4978-8790-272491115280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3991430e-af52-4fe6-ae30-9b116b39d69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3991430e-af52-4fe6-ae30-9b116b39d69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d7f319-3821-4742-9ab8-a2ad1d212146', 'volume_name': 'volume-11d7f319-3821-4742-9ab8-a2ad1d212146', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cfc153-8e71-4a09-ab26-fb1b89a5a732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cfc153-8e71-4a09-ab26-fb1b89a5a732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecb5c36-cef3-467b-9481-4e4692113c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume 11d7f319-3821-4742-9ab8-a2ad1d212146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d7f319-3821-4742-9ab8-a2ad1d212146', 'volume_size': 1} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279120953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d7f319-3821-4742-9ab8-a2ad1d212146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82ed0a00c984dde8d12f75c67f9f7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:54Z,use_quota=True,user_id='dcd8e9421d8947788140c9a19daf608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Creating volume 11d7f319-3821-4742-9ab8-a2ad1d212146 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:14:54 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:54 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 1073741824 Jul 18 06:14:54 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:54 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 1073741824" returned: 0 in 0.404s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:54 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 Jul 18 06:14:54 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:54 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146" returned: 0 in 0.235s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecb5c36-cef3-467b-9481-4e4692113c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d7f319-3821-4742-9ab8-a2ad1d212146', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f389a4-9b8f-4686-95fb-1d48faf6f5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume volume-11d7f319-3821-4742-9ab8-a2ad1d212146 (11d7f319-3821-4742-9ab8-a2ad1d212146): created successfully Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f389a4-9b8f-4686-95fb-1d48faf6f5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Flow 'volume_create_manager' (2813e401-64cc-4271-b455-879a3468f7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b96b9874-fab3-4d7e-8ae4-06fa82f12991 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created volume successfully. Jul 18 06:14:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] Creating offline snapshot ad48855a-9b52-4316-9ea1-cda08619b8be of volume 11d7f319-3821-4742-9ab8-a2ad1d212146 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:14:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d490eb6d-cefa-456e-b121-a1e9b16b90ad]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:14:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:55 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 Jul 18 06:14:55 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:55 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:55 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be 1G Jul 18 06:14:55 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:56 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be 1G" returned: 0 in 0.384s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d7f319-3821-4742-9ab8-a2ad1d212146 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:56 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d7f319-3821-4742-9ab8-a2ad1d212146 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be Jul 18 06:14:56 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:56 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d7f319-3821-4742-9ab8-a2ad1d212146 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be" returned: 0 in 0.277s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:56 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be is being set with open permissions: ugo+rw Jul 18 06:14:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:56 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be Jul 18 06:14:56 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:56 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:56 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.info Jul 18 06:14:56 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:56 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.info" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:56 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.info is being set with open permissions: ugo+rw Jul 18 06:14:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:56 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.info Jul 18 06:14:56 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:57 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.info" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f447fec2-d184-4467-aa99-d3c592e29acc tempest-CreateVolumesFromSnapshotTest-1833803832 None] Create snapshot completed successfully Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Flow 'volume_create_manager' (e9cebea3-7284-4ebb-90c1-bad41c5a7cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e29e68-39bc-4188-900c-4ab7a1bb3cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e29e68-39bc-4188-900c-4ab7a1bb3cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647827800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6336bebf-6136-40f0-918f-d83242853979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82ed0a00c984dde8d12f75c67f9f7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:58Z,use_quota=True,user_id='dcd8e9421d8947788140c9a19daf608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397a276f-c12e-48a0-88ab-2005751cf6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397a276f-c12e-48a0-88ab-2005751cf6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba10fcd5-7d86-4f94-b15f-90f63d7434ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba10fcd5-7d86-4f94-b15f-90f63d7434ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6336bebf-6136-40f0-918f-d83242853979', 'volume_name': 'volume-6336bebf-6136-40f0-918f-d83242853979', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8f0bfc-a51b-4f0d-a187-6b5e47f13e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f8f0bfc-a51b-4f0d-a187-6b5e47f13e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35594bf9-876a-4aff-b2fa-3b28e9a11e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume 6336bebf-6136-40f0-918f-d83242853979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6336bebf-6136-40f0-918f-d83242853979', 'volume_size': 1} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647827800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6336bebf-6136-40f0-918f-d83242853979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82ed0a00c984dde8d12f75c67f9f7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:58Z,use_quota=True,user_id='dcd8e9421d8947788140c9a19daf608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Creating volume 6336bebf-6136-40f0-918f-d83242853979 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:14:57 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:14:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6336bebf-6136-40f0-918f-d83242853979 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:57 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6336bebf-6136-40f0-918f-d83242853979 1073741824 Jul 18 06:14:57 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Flow 'volume_create_manager' (891e0c44-9537-47e0-8b26-e4fd6d9b5dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445ceb43-d175-4fef-a5df-c67bd786daf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (445ceb43-d175-4fef-a5df-c67bd786daf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1979885536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5282886-e253-4dd0-80b9-e5f306346aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82ed0a00c984dde8d12f75c67f9f7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:58Z,use_quota=True,user_id='dcd8e9421d8947788140c9a19daf608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e599bafe-d6de-4d85-bc5d-ac9246e40049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e599bafe-d6de-4d85-bc5d-ac9246e40049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350a0f28-8c9f-427a-bac8-deec4c9982a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350a0f28-8c9f-427a-bac8-deec4c9982a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5282886-e253-4dd0-80b9-e5f306346aee', 'volume_name': 'volume-a5282886-e253-4dd0-80b9-e5f306346aee', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136b4483-3724-4f58-bf5c-35a1489f7d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136b4483-3724-4f58-bf5c-35a1489f7d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebac49f9-c345-4947-903f-bb6c4a5b82e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume a5282886-e253-4dd0-80b9-e5f306346aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5282886-e253-4dd0-80b9-e5f306346aee', 'volume_size': 1} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:58 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6336bebf-6136-40f0-918f-d83242853979 1073741824" returned: 0 in 0.566s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6336bebf-6136-40f0-918f-d83242853979 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:58 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6336bebf-6136-40f0-918f-d83242853979 Jul 18 06:14:58 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Flow 'volume_create_manager' (47e533bd-5d64-41e0-8a61-89b0d5b480fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d851b431-c157-4830-9bef-97f3067285ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d851b431-c157-4830-9bef-97f3067285ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1307355113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd5c2ee-188b-48b9-9642-ba77306253ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82ed0a00c984dde8d12f75c67f9f7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:59Z,use_quota=True,user_id='dcd8e9421d8947788140c9a19daf608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8a1be3-448b-48f1-b148-fd58ade14617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8a1be3-448b-48f1-b148-fd58ade14617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2e7135-4d96-48d4-a9be-58a285b64679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2e7135-4d96-48d4-a9be-58a285b64679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd5c2ee-188b-48b9-9642-ba77306253ff', 'volume_name': 'volume-ebd5c2ee-188b-48b9-9642-ba77306253ff', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5df42fc-bfe3-4fd1-9245-08e0f72f0834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5df42fc-bfe3-4fd1-9245-08e0f72f0834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9803ee8b-8c44-4c35-b3bf-f9f77418ae75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume ebd5c2ee-188b-48b9-9642-ba77306253ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd5c2ee-188b-48b9-9642-ba77306253ff', 'volume_size': 1} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:58 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6336bebf-6136-40f0-918f-d83242853979" returned: 0 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1979885536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5282886-e253-4dd0-80b9-e5f306346aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82ed0a00c984dde8d12f75c67f9f7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:58Z,use_quota=True,user_id='dcd8e9421d8947788140c9a19daf608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Creating volume a5282886-e253-4dd0-80b9-e5f306346aee {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:14:58 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a5282886-e253-4dd0-80b9-e5f306346aee 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35594bf9-876a-4aff-b2fa-3b28e9a11e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6336bebf-6136-40f0-918f-d83242853979', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:58 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a5282886-e253-4dd0-80b9-e5f306346aee 1073741824 Jul 18 06:14:58 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f45be43-ad1b-4c43-8bd6-97932683a12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume volume-6336bebf-6136-40f0-918f-d83242853979 (6336bebf-6136-40f0-918f-d83242853979): created successfully Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f45be43-ad1b-4c43-8bd6-97932683a12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Flow 'volume_create_manager' (e9cebea3-7284-4ebb-90c1-bad41c5a7cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-317bc190-2fde-438d-b0fc-60bb3687f115 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created volume successfully. Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Flow 'volume_create_manager' (e9ca2c06-4e43-4b40-8ac4-032ab9280751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f97584b-a11e-4591-93e3-3c2f99a46352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f97584b-a11e-4591-93e3-3c2f99a46352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1097054564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7abac2-ebb0-4e28-93ad-9b837eb51640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82ed0a00c984dde8d12f75c67f9f7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:59Z,use_quota=True,user_id='dcd8e9421d8947788140c9a19daf608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6c072c-ddb6-43b3-9f33-f8b39e9aee4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6c072c-ddb6-43b3-9f33-f8b39e9aee4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170178d2-c51d-4dfb-8b4d-542592a53a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170178d2-c51d-4dfb-8b4d-542592a53a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e7abac2-ebb0-4e28-93ad-9b837eb51640', 'volume_name': 'volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ce6a1f-d0fb-491b-9634-dce4b95d7a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ce6a1f-d0fb-491b-9634-dce4b95d7a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdedbf7-454f-49dc-9cae-c0ca0a60b1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume 2e7abac2-ebb0-4e28-93ad-9b837eb51640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640', 'volume_size': 1} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Flow 'volume_create_manager' (5ca12558-b694-495b-9f83-fafd1f3d36a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:59 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27f3744-268b-4b14-aace-d6375cdf82e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a5282886-e253-4dd0-80b9-e5f306346aee 1073741824" returned: 0 in 0.503s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27f3744-268b-4b14-aace-d6375cdf82e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447183856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4613b68b-de7d-4017-8327-4434ff31c263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82ed0a00c984dde8d12f75c67f9f7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:59Z,use_quota=True,user_id='dcd8e9421d8947788140c9a19daf608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29244ca4-f319-4d73-8257-5118083ec4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29244ca4-f319-4d73-8257-5118083ec4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffb84d0-33f7-4c37-8072-7a7a2fc882fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fffb84d0-33f7-4c37-8072-7a7a2fc882fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4613b68b-de7d-4017-8327-4434ff31c263', 'volume_name': 'volume-4613b68b-de7d-4017-8327-4434ff31c263', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586459b5-a9cd-4940-bd72-999a255191b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586459b5-a9cd-4940-bd72-999a255191b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ae5f2d-2c23-4f20-91a6-2d359e99b1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume 4613b68b-de7d-4017-8327-4434ff31c263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4613b68b-de7d-4017-8327-4434ff31c263', 'volume_size': 1} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a5282886-e253-4dd0-80b9-e5f306346aee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:59 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a5282886-e253-4dd0-80b9-e5f306346aee Jul 18 06:14:59 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:59 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a5282886-e253-4dd0-80b9-e5f306346aee" returned: 0 in 0.236s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1307355113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd5c2ee-188b-48b9-9642-ba77306253ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82ed0a00c984dde8d12f75c67f9f7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:59Z,use_quota=True,user_id='dcd8e9421d8947788140c9a19daf608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Creating volume ebd5c2ee-188b-48b9-9642-ba77306253ff {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:14:59 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ebd5c2ee-188b-48b9-9642-ba77306253ff 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:14:59 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ebd5c2ee-188b-48b9-9642-ba77306253ff 1073741824 Jul 18 06:14:59 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebac49f9-c345-4947-903f-bb6c4a5b82e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5282886-e253-4dd0-80b9-e5f306346aee', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3814c4e-ca9f-40b7-b5cb-e0dfe3fb870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:14:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume volume-a5282886-e253-4dd0-80b9-e5f306346aee (a5282886-e253-4dd0-80b9-e5f306346aee): created successfully Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3814c4e-ca9f-40b7-b5cb-e0dfe3fb870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:14:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Flow 'volume_create_manager' (891e0c44-9537-47e0-8b26-e4fd6d9b5dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:14:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-70b471f9-9bba-496d-9ff3-a04fd321ae85 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created volume successfully. Jul 18 06:15:00 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ebd5c2ee-188b-48b9-9642-ba77306253ff 1073741824" returned: 0 in 0.406s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ebd5c2ee-188b-48b9-9642-ba77306253ff {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:00 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ebd5c2ee-188b-48b9-9642-ba77306253ff Jul 18 06:15:00 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:00 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ebd5c2ee-188b-48b9-9642-ba77306253ff" returned: 0 in 0.247s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.272s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1097054564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7abac2-ebb0-4e28-93ad-9b837eb51640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82ed0a00c984dde8d12f75c67f9f7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:59Z,use_quota=True,user_id='dcd8e9421d8947788140c9a19daf608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Creating volume 2e7abac2-ebb0-4e28-93ad-9b837eb51640 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:15:00 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9803ee8b-8c44-4c35-b3bf-f9f77418ae75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd5c2ee-188b-48b9-9642-ba77306253ff', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:00 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640 1073741824 Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc712c19-9513-4d7d-a672-1b486f4daf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:00 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:00 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume volume-ebd5c2ee-188b-48b9-9642-ba77306253ff (ebd5c2ee-188b-48b9-9642-ba77306253ff): created successfully Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc712c19-9513-4d7d-a672-1b486f4daf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Flow 'volume_create_manager' (47e533bd-5d64-41e0-8a61-89b0d5b480fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ff7975c9-4825-404c-b6a2-5be2aa809a74 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created volume successfully. Jul 18 06:15:00 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640 1073741824" returned: 0 in 0.420s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:00 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640 Jul 18 06:15:00 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:01 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640" returned: 0 in 0.240s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.666s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-447183856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4613b68b-de7d-4017-8327-4434ff31c263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82ed0a00c984dde8d12f75c67f9f7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:14:59Z,use_quota=True,user_id='dcd8e9421d8947788140c9a19daf608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Creating volume 4613b68b-de7d-4017-8327-4434ff31c263 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:15:01 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4613b68b-de7d-4017-8327-4434ff31c263 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cdedbf7-454f-49dc-9cae-c0ca0a60b1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:01 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4613b68b-de7d-4017-8327-4434ff31c263 1073741824 Jul 18 06:15:01 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86223243-3ee9-4469-9eab-fc6983aecd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:01 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640 (2e7abac2-ebb0-4e28-93ad-9b837eb51640): created successfully Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86223243-3ee9-4469-9eab-fc6983aecd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Flow 'volume_create_manager' (e9ca2c06-4e43-4b40-8ac4-032ab9280751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-884b451a-54d5-4163-a525-6d08de9136d3 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created volume successfully. Jul 18 06:15:01 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4613b68b-de7d-4017-8327-4434ff31c263 1073741824" returned: 0 in 0.458s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4613b68b-de7d-4017-8327-4434ff31c263 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:01 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4613b68b-de7d-4017-8327-4434ff31c263 Jul 18 06:15:01 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:01 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4613b68b-de7d-4017-8327-4434ff31c263" returned: 0 in 0.259s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ae5f2d-2c23-4f20-91a6-2d359e99b1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4613b68b-de7d-4017-8327-4434ff31c263', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a893207-c2ed-4788-a49d-4d640f3bc3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:01 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Volume volume-4613b68b-de7d-4017-8327-4434ff31c263 (4613b68b-de7d-4017-8327-4434ff31c263): created successfully Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a893207-c2ed-4788-a49d-4d640f3bc3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Flow 'volume_create_manager' (5ca12558-b694-495b-9f83-fafd1f3d36a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d6ddc215-3816-456c-a983-6e8def85504c tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created volume successfully. Jul 18 06:15:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-4613b68b-de7d-4017-8327-4434ff31c263-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-4613b68b-de7d-4017-8327-4434ff31c263-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-quobyte-4613b68b-de7d-4017-8327-4434ff31c263" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-4613b68b-de7d-4017-8327-4434ff31c263" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb04bf2b-25a3-4833-9ece-d9ea43468774]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4613b68b-de7d-4017-8327-4434ff31c263 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:02 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4613b68b-de7d-4017-8327-4434ff31c263 Jul 18 06:15:02 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:03 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4613b68b-de7d-4017-8327-4434ff31c263" returned: 0 in 0.355s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4613b68b-de7d-4017-8327-4434ff31c263 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:03 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4613b68b-de7d-4017-8327-4434ff31c263 Jul 18 06:15:03 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:03 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4613b68b-de7d-4017-8327-4434ff31c263" returned: 0 in 0.241s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-4613b68b-de7d-4017-8327-4434ff31c263" released by "delete_volume" :: held 0.638s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created reservations ['1a79e4fd-1459-4212-adef-27f6afad666d', 'fc87596a-1b4f-4245-91ff-b3a0fbe48bdb', '12f75f1a-ea50-43aa-8a96-d77f871bfe7c', '3784bb64-f7b2-4bd7-8ba6-82471a389481'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:03 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:15:03 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:03 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:15:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Deleted volume successfully. Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04dd0806-bdb6-4ea9-a40d-456975c5f42d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-4613b68b-de7d-4017-8327-4434ff31c263-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-2e7abac2-ebb0-4e28-93ad-9b837eb51640-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-2e7abac2-ebb0-4e28-93ad-9b837eb51640-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-quobyte-2e7abac2-ebb0-4e28-93ad-9b837eb51640" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-2e7abac2-ebb0-4e28-93ad-9b837eb51640" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b31ab3-ca97-48f4-88bb-d18529574664]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:04 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640 Jul 18 06:15:04 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:04 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640" returned: 0 in 0.352s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:04 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640 Jul 18 06:15:04 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:04 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-2e7abac2-ebb0-4e28-93ad-9b837eb51640" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-2e7abac2-ebb0-4e28-93ad-9b837eb51640" released by "delete_volume" :: held 0.628s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created reservations ['b4fd15cd-1b64-44f1-b0f4-b4e7226e2881', 'b223c209-5c4f-42df-890f-796e6c211a0c', '1c3a384c-0e0b-4cad-8916-0259e8d25ff7', '111d9129-280d-4ac8-9955-8082e174d51c'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:04 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:15:04 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:04 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:15:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Deleted volume successfully. Jul 18 06:15:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7b41f006-2d48-42c3-86fd-cabb8256a414 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-2e7abac2-ebb0-4e28-93ad-9b837eb51640-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-ebd5c2ee-188b-48b9-9642-ba77306253ff-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-ebd5c2ee-188b-48b9-9642-ba77306253ff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-quobyte-ebd5c2ee-188b-48b9-9642-ba77306253ff" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-ebd5c2ee-188b-48b9-9642-ba77306253ff" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[949394de-9e61-4ee6-aff3-c60a693083b1]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ebd5c2ee-188b-48b9-9642-ba77306253ff {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:05 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ebd5c2ee-188b-48b9-9642-ba77306253ff Jul 18 06:15:05 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:05 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ebd5c2ee-188b-48b9-9642-ba77306253ff" returned: 0 in 0.340s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ebd5c2ee-188b-48b9-9642-ba77306253ff {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:05 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ebd5c2ee-188b-48b9-9642-ba77306253ff Jul 18 06:15:05 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:05 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ebd5c2ee-188b-48b9-9642-ba77306253ff" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-ebd5c2ee-188b-48b9-9642-ba77306253ff" released by "delete_volume" :: held 0.615s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created reservations ['f6f44528-8a81-48b6-9b33-512278c0565f', 'af22edf3-a236-4b09-972d-4a0e9d9cb78e', '24401b9c-d514-43bc-929b-e341fa82accd', '08100f12-17cf-4655-b843-480a55f57027'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:05 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:15:05 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:06 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:15:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Deleted volume successfully. Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-373fecd3-cc80-4241-8887-5e92c3efdfc6 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-ebd5c2ee-188b-48b9-9642-ba77306253ff-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-a5282886-e253-4dd0-80b9-e5f306346aee-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-a5282886-e253-4dd0-80b9-e5f306346aee-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-quobyte-a5282886-e253-4dd0-80b9-e5f306346aee" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-a5282886-e253-4dd0-80b9-e5f306346aee" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c9a2c-e690-4986-a5d4-2d4d5647c957]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a5282886-e253-4dd0-80b9-e5f306346aee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:06 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a5282886-e253-4dd0-80b9-e5f306346aee Jul 18 06:15:06 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:06 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a5282886-e253-4dd0-80b9-e5f306346aee" returned: 0 in 0.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a5282886-e253-4dd0-80b9-e5f306346aee {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:06 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a5282886-e253-4dd0-80b9-e5f306346aee Jul 18 06:15:06 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:06 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a5282886-e253-4dd0-80b9-e5f306346aee" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-a5282886-e253-4dd0-80b9-e5f306346aee" released by "delete_volume" :: held 0.632s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created reservations ['843dbaef-16fc-4cdf-8aeb-e587dc088a82', '281f4a36-8c12-4447-bae2-7aa35efcf002', 'ba06e361-70d8-4329-81af-96e4fa94fac7', '50e8c9f4-4bc9-4165-97dc-e2fa685154a2'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:07 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:15:07 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:07 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.232s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:07 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:15:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Deleted volume successfully. Jul 18 06:15:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-465c74e5-e5cb-4cfd-a319-d7ed49cce697 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-a5282886-e253-4dd0-80b9-e5f306346aee-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-6336bebf-6136-40f0-918f-d83242853979-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-6336bebf-6136-40f0-918f-d83242853979-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-quobyte-6336bebf-6136-40f0-918f-d83242853979" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-6336bebf-6136-40f0-918f-d83242853979" acquired by "delete_volume" :: waited 0.012s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a030420-1fac-4ad4-83b4-61139feef9b2]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6336bebf-6136-40f0-918f-d83242853979 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:07 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6336bebf-6136-40f0-918f-d83242853979 Jul 18 06:15:07 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:07 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6336bebf-6136-40f0-918f-d83242853979" returned: 0 in 0.346s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6336bebf-6136-40f0-918f-d83242853979 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:07 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6336bebf-6136-40f0-918f-d83242853979 Jul 18 06:15:07 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:08 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6336bebf-6136-40f0-918f-d83242853979" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-6336bebf-6136-40f0-918f-d83242853979" released by "delete_volume" :: held 0.621s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created reservations ['d452d9cd-1a50-40a4-bc0c-aabe57ecf6c0', '1fb54c13-beaa-4ead-ad1c-fb82382ce06b', 'e2d93fcf-74e4-4c3c-af03-116320acfb87', '70195df1-da02-4742-a9ce-41621eff043e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:08 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:15:08 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:08 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.232s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:15:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Deleted volume successfully. Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-76a30942-e257-46fb-841b-6af727fc1a50 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-6336bebf-6136-40f0-918f-d83242853979-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-ad48855a-9b52-4316-9ea1-cda08619b8be-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-ad48855a-9b52-4316-9ea1-cda08619b8be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-quobyte-11d7f319-3821-4742-9ab8-a2ad1d212146" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-11d7f319-3821-4742-9ab8-a2ad1d212146" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-quobyte-ad48855a-9b52-4316-9ea1-cda08619b8be" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-ad48855a-9b52-4316-9ea1-cda08619b8be" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Deleting offline snapshot ad48855a-9b52-4316-9ea1-cda08619b8be of volume 11d7f319-3821-4742-9ab8-a2ad1d212146 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] snapshot_file for this snap is: volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73e3be6-523e-42b4-8ee2-4853d585be43]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:08 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be Jul 18 06:15:08 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:08 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be" returned: 0 in 0.382s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d7f319-3821-4742-9ab8-a2ad1d212146(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c77709-4236-430f-ad3f-7b1d61c2bd2b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:09 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 Jul 18 06:15:09 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:09 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146" returned: 0 in 0.344s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:09 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be Jul 18 06:15:09 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:09 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be" returned: 0 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:09 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be Jul 18 06:15:09 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:09 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146.ad48855a-9b52-4316-9ea1-cda08619b8be" returned: 0 in 0.243s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-ad48855a-9b52-4316-9ea1-cda08619b8be" released by "_delete_snapshot" :: held 1.389s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-11d7f319-3821-4742-9ab8-a2ad1d212146" released by "delete_snapshot" :: held 1.412s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:09 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created reservations ['43c0a312-9a27-4322-9a25-a19017714199', 'b1669cc7-58bd-45d7-a766-e0d6fccdac9a', '26d80783-942c-48ea-807c-b3ec9af53aff', '6ed4c31a-1fa5-40f8-8ab5-53d4e91cdd61'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:15:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Delete snapshot completed successfully. Jul 18 06:15:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21765005-0121-4ec2-99ed-22dfbc644066 tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-ad48855a-9b52-4316-9ea1-cda08619b8be-delete_snapshot" released by "delete_snapshot" :: held 1.534s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-11d7f319-3821-4742-9ab8-a2ad1d212146-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-11d7f319-3821-4742-9ab8-a2ad1d212146-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "cinder-quobyte-11d7f319-3821-4742-9ab8-a2ad1d212146" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-11d7f319-3821-4742-9ab8-a2ad1d212146" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:10 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb96e43a-1dd0-4ec9-a6ca-88db9774ca4d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:10 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 Jul 18 06:15:10 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:11 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146" returned: 0 in 0.340s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:11 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146 Jul 18 06:15:11 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:11 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-11d7f319-3821-4742-9ab8-a2ad1d212146" returned: 0 in 0.230s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-quobyte-11d7f319-3821-4742-9ab8-a2ad1d212146" released by "delete_volume" :: held 0.624s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Created reservations ['3da0ba3c-2dc2-4cee-8e78-db0922ae9386', '99f6c77c-252c-4480-aaa8-9cb5e3dfeff9', '5c8693b9-5a42-4b5f-9284-3e7dbc1fcece', 'e78109c9-f059-4918-8192-494a0d9cbe93'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:11 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:15:11 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:11 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.246s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:15:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Deleted volume successfully. Jul 18 06:15:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-13efe14f-f9ec-4a32-81a5-920e8d85e74d tempest-CreateVolumesFromSnapshotTest-1833803832 None] Lock "cinder-11d7f319-3821-4742-9ab8-a2ad1d212146-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Flow 'volume_create_manager' (29495a06-81e8-4402-98d7-864b76003b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37517082-d030-4d8f-b368-b9d3f1ff0138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37517082-d030-4d8f-b368-b9d3f1ff0138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1628909664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34afc6a-4b8c-4120-894e-8ea6d326268f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49ca87d33b94044bcff18ede0e0dce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:14Z,use_quota=True,user_id='9ea63baf67a04e73947f62cbf318ce37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e170b3a3-5aa6-4dfd-a614-cfb630583193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e170b3a3-5aa6-4dfd-a614-cfb630583193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a8c76a-9412-4882-9c76-74ae6f590313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a8c76a-9412-4882-9c76-74ae6f590313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34afc6a-4b8c-4120-894e-8ea6d326268f', 'volume_name': 'volume-b34afc6a-4b8c-4120-894e-8ea6d326268f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebde1d5-fe4a-40dd-935e-757a5dccafa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ebde1d5-fe4a-40dd-935e-757a5dccafa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678257c9-e993-49bf-9a8d-eeeabfc122f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:14 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Volume b34afc6a-4b8c-4120-894e-8ea6d326268f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34afc6a-4b8c-4120-894e-8ea6d326268f', 'volume_size': 1} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1628909664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34afc6a-4b8c-4120-894e-8ea6d326268f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49ca87d33b94044bcff18ede0e0dce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:14Z,use_quota=True,user_id='9ea63baf67a04e73947f62cbf318ce37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Creating volume b34afc6a-4b8c-4120-894e-8ea6d326268f {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:15:14 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:14 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f 1073741824 Jul 18 06:15:14 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:14 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f 1073741824" returned: 0 in 0.391s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:14 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f Jul 18 06:15:14 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:15 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f" returned: 0 in 0.241s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678257c9-e993-49bf-9a8d-eeeabfc122f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34afc6a-4b8c-4120-894e-8ea6d326268f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1b400f-e345-4411-bff9-ae2ae0765c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:15 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Volume volume-b34afc6a-4b8c-4120-894e-8ea6d326268f (b34afc6a-4b8c-4120-894e-8ea6d326268f): created successfully Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1b400f-e345-4411-bff9-ae2ae0765c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Flow 'volume_create_manager' (29495a06-81e8-4402-98d7-864b76003b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5ada4152-f4d8-4a0d-992c-9697a66132d5 tempest-VolumeDependencyTests-1891583201 None] Created volume successfully. Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] Creating offline snapshot d22a4406-065b-4a15-925b-31f5577d4968 of volume b34afc6a-4b8c-4120-894e-8ea6d326268f {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a773b0-ba0e-4144-853c-aefbae1b760e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:15 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f Jul 18 06:15:15 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:15 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f" returned: 0 in 0.350s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:15 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 1G Jul 18 06:15:15 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:16 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 1G" returned: 0 in 0.372s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b34afc6a-4b8c-4120-894e-8ea6d326268f -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:16 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b34afc6a-4b8c-4120-894e-8ea6d326268f -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 Jul 18 06:15:16 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:16 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b34afc6a-4b8c-4120-894e-8ea6d326268f -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968" returned: 0 in 0.281s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:16 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 is being set with open permissions: ugo+rw Jul 18 06:15:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:16 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 Jul 18 06:15:16 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:16 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:16 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.info Jul 18 06:15:16 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:17 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.info" returned: 0 in 0.241s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:17 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.info is being set with open permissions: ugo+rw Jul 18 06:15:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:17 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.info Jul 18 06:15:17 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:17 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.info" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6c92095f-1308-4be8-befc-74b5dbdfc8bf tempest-VolumeDependencyTests-1891583201 None] Create snapshot completed successfully Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Flow 'volume_create_manager' (10405476-44be-48f8-8938-81adb092ad93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcec1bc8-711f-4fda-b0f8-e5ad0a9b31f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcec1bc8-711f-4fda-b0f8-e5ad0a9b31f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-653036748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e45603c-ece4-48ae-a02c-9fb14135fac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49ca87d33b94044bcff18ede0e0dce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d22a4406-065b-4a15-925b-31f5577d4968,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:18Z,use_quota=True,user_id='9ea63baf67a04e73947f62cbf318ce37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef5d75e-ae2a-4d41-8aed-2e1c6f62c235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef5d75e-ae2a-4d41-8aed-2e1c6f62c235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f463c4-64cd-45c2-baf4-c9f42e0380a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f463c4-64cd-45c2-baf4-c9f42e0380a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e45603c-ece4-48ae-a02c-9fb14135fac0', 'volume_name': 'volume-1e45603c-ece4-48ae-a02c-9fb14135fac0', 'volume_size': 1, 'snapshot_id': 'd22a4406-065b-4a15-925b-31f5577d4968'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239e813c-417f-4fc8-b103-28b490de10c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239e813c-417f-4fc8-b103-28b490de10c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c5cd7f-bb51-4b66-a360-27ac83666ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:18 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Volume 1e45603c-ece4-48ae-a02c-9fb14135fac0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e45603c-ece4-48ae-a02c-9fb14135fac0', 'volume_size': 1, 'snapshot_id': 'd22a4406-065b-4a15-925b-31f5577d4968'} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "cinder-quobyte-d22a4406-065b-4a15-925b-31f5577d4968-1e45603c-ece4-48ae-a02c-9fb14135fac0" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-quobyte-d22a4406-065b-4a15-925b-31f5577d4968-1e45603c-ece4-48ae-a02c-9fb14135fac0" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Creating volume 1e45603c-ece4-48ae-a02c-9fb14135fac0 from snapshot d22a4406-065b-4a15-925b-31f5577d4968 {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "cinder-quobyte-1e45603c-ece4-48ae-a02c-9fb14135fac0" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-quobyte-1e45603c-ece4-48ae-a02c-9fb14135fac0" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] snapshot: d22a4406-065b-4a15-925b-31f5577d4968, volume: 1e45603c-ece4-48ae-a02c-9fb14135fac0, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde1a91f-dd25-4cbd-99a8-e62309fdaaac]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:18 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 Jul 18 06:15:18 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:18 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968" returned: 0 in 0.350s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b34afc6a-4b8c-4120-894e-8ea6d326268f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de0d4fc-698e-4380-9596-e8eadd1e7e44]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:18 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f Jul 18 06:15:18 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:18 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f" returned: 0 in 0.336s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Path /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0 not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 06:15:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:19 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0 Jul 18 06:15:19 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:22 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0" returned: 0 in 3.831s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e1d8e4-fb8f-4cbb-8532-08717b635afc]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:22 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f Jul 18 06:15:22 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:23 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f" returned: 0 in 0.528s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:23 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f, size 1024.00 MB, duration 3.83 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:15:23 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Converted 1024.00 MB image at 267.22 MB/s Jul 18 06:15:23 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0 is being set with open permissions: ugo+rw Jul 18 06:15:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:23 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0 Jul 18 06:15:23 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:23 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0" returned: 0 in 0.228s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-quobyte-1e45603c-ece4-48ae-a02c-9fb14135fac0" released by "_copy_volume_from_snapshot" :: held 5.357s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-quobyte-d22a4406-065b-4a15-925b-31f5577d4968-1e45603c-ece4-48ae-a02c-9fb14135fac0" released by "_create_volume_from_snapshot" :: held 5.382s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.396s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c5cd7f-bb51-4b66-a360-27ac83666ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e45603c-ece4-48ae-a02c-9fb14135fac0', 'volume_size': 1, 'snapshot_id': 'd22a4406-065b-4a15-925b-31f5577d4968'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f19a560-cd48-4e28-91b1-f2f9536b29fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:23 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Volume volume-1e45603c-ece4-48ae-a02c-9fb14135fac0 (1e45603c-ece4-48ae-a02c-9fb14135fac0): created successfully Jul 18 06:15:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f19a560-cd48-4e28-91b1-f2f9536b29fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Flow 'volume_create_manager' (10405476-44be-48f8-8938-81adb092ad93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6291b4a8-8628-4243-b6f9-d1f84f6610b0 tempest-VolumeDependencyTests-1891583201 None] Created volume successfully. Jul 18 06:15:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "cinder-d22a4406-065b-4a15-925b-31f5577d4968-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-d22a4406-065b-4a15-925b-31f5577d4968-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "cinder-quobyte-b34afc6a-4b8c-4120-894e-8ea6d326268f" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-quobyte-b34afc6a-4b8c-4120-894e-8ea6d326268f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "cinder-quobyte-d22a4406-065b-4a15-925b-31f5577d4968" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-quobyte-d22a4406-065b-4a15-925b-31f5577d4968" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Deleting offline snapshot d22a4406-065b-4a15-925b-31f5577d4968 of volume b34afc6a-4b8c-4120-894e-8ea6d326268f {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:15:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] snapshot_file for this snap is: volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:15:24 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac83447-e1e8-4566-84e1-c4ca3e2d3b96]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:24 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 Jul 18 06:15:24 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:25 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968" returned: 0 in 0.337s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b34afc6a-4b8c-4120-894e-8ea6d326268f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:15:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4f2b0f-85e5-4ac8-99bd-280a3b26f15b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:25 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f Jul 18 06:15:25 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:25 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f" returned: 0 in 0.342s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:25 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 Jul 18 06:15:25 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:25 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968" returned: 0 in 0.329s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:25 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968 Jul 18 06:15:25 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:25 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f.d22a4406-065b-4a15-925b-31f5577d4968" returned: 0 in 0.234s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:25 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=113,cinder:UPDATE=141,cinder:INSERT=34,cinder:DELETE=14 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:15:25 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=154,cinder:SELECT=104,cinder:INSERT=43,cinder:DELETE=14 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:15:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-quobyte-d22a4406-065b-4a15-925b-31f5577d4968" released by "_delete_snapshot" :: held 1.346s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-quobyte-b34afc6a-4b8c-4120-894e-8ea6d326268f" released by "delete_snapshot" :: held 1.372s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:26 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Created reservations ['8b461679-ca8d-44a8-b73b-a34d6103ba44', '5b24a32d-c2e0-4fd1-a4c3-ad53c0dcb72f', '542328da-c12a-4455-959d-502c525969dc', '9ff91a1d-abe5-4711-8cb3-1c1b8ba0bc2a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:15:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Delete snapshot completed successfully. Jul 18 06:15:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-1adef1d2-d612-4023-bad3-42ef7a22dc39 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-d22a4406-065b-4a15-925b-31f5577d4968-delete_snapshot" released by "delete_snapshot" :: held 1.492s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "cinder-b34afc6a-4b8c-4120-894e-8ea6d326268f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-b34afc6a-4b8c-4120-894e-8ea6d326268f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "cinder-quobyte-b34afc6a-4b8c-4120-894e-8ea6d326268f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-quobyte-b34afc6a-4b8c-4120-894e-8ea6d326268f" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de0d936-5291-4cee-bc6d-1a616dd8ac04]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:26 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f Jul 18 06:15:26 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:27 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f" returned: 0 in 0.350s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:27 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f Jul 18 06:15:27 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:27 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-b34afc6a-4b8c-4120-894e-8ea6d326268f" returned: 0 in 0.233s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-quobyte-b34afc6a-4b8c-4120-894e-8ea6d326268f" released by "delete_volume" :: held 0.633s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Created reservations ['6bbe19ab-8dcd-4ea7-b84e-826ff208b354', '78e7089a-6fd4-4209-84b7-d64bfcf98412', '1d6bc4e1-5bd5-46e5-a18c-f5a373c25c32', '42f9a6c5-6ab1-4c8e-ba13-4185e40af6b9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:27 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:15:27 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:27 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.232s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:15:27 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Deleted volume successfully. Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-281c1265-ebd1-4b92-bd1f-ca802ac00069 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-b34afc6a-4b8c-4120-894e-8ea6d326268f-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "cinder-1e45603c-ece4-48ae-a02c-9fb14135fac0-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-1e45603c-ece4-48ae-a02c-9fb14135fac0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "cinder-quobyte-1e45603c-ece4-48ae-a02c-9fb14135fac0" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-quobyte-1e45603c-ece4-48ae-a02c-9fb14135fac0" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba49c4a-361e-4a6f-9da7-cd5bb432b811]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:28 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0 Jul 18 06:15:28 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:28 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0" returned: 0 in 0.342s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:28 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0 Jul 18 06:15:28 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:28 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1e45603c-ece4-48ae-a02c-9fb14135fac0" returned: 0 in 0.239s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-quobyte-1e45603c-ece4-48ae-a02c-9fb14135fac0" released by "delete_volume" :: held 0.617s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Created reservations ['99b4ee0e-0ae0-4a16-ae10-6392be270740', '2429d206-50df-4655-95a2-eb0145933ac9', '06d81825-d8e2-48ff-b9fb-32d74f8e4ece', '83a487be-aace-4418-80f9-1516013831dc'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:28 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:15:28 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:28 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.238s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:15:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Deleted volume successfully. Jul 18 06:15:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a5cda9b9-1db8-48bb-8df5-600f274d6a63 tempest-VolumeDependencyTests-1891583201 None] Lock "cinder-1e45603c-ece4-48ae-a02c-9fb14135fac0-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:33 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:15:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Flow 'volume_create_manager' (ae39fe2e-0f43-48a0-bf36-15a9f62fe66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56474bcc-1150-46be-b3bc-7e2b88ab4372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56474bcc-1150-46be-b3bc-7e2b88ab4372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1253ffbd-8442-46fa-860e-c9f310d09b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ac061296f94a6e81f770ad8712e302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:34Z,use_quota=True,user_id='9c53f8a054394a6ba9ead177b9183098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9651bc46-668c-4ed3-a1d2-59149cba7c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9651bc46-668c-4ed3-a1d2-59149cba7c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:33 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c829bb63-6a84-4842-864d-cd0b5e201daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:33 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c829bb63-6a84-4842-864d-cd0b5e201daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1253ffbd-8442-46fa-860e-c9f310d09b27', 'volume_name': 'volume-1253ffbd-8442-46fa-860e-c9f310d09b27', 'volume_size': 1, 'image_id': 'a88d0559-7c40-4cca-9b04-6d7399edad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a88d0559-7c40-4cca-9b04-6d7399edad8b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '701fea62ebd7a2967b1e05ac5b79c18d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1ac061296f94a6e81f770ad8712e302', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3854ef5114c8bde1450cb0bee2e6622804de7852e738a21d0e22e32489ca56f2cec6fd0d037064b34d51a56dc5af04d216f2024671c3ca24358553bcfa17a87f', 'id': 'a88d0559-7c40-4cca-9b04-6d7399edad8b', 'created_at': datetime.datetime(2026, 7, 18, 4, 15, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a88d0559-7c40-4cca-9b04-6d7399edad8b/file', 'properties': {}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedd5351-cb7f-4c27-9ae0-60e835fd98fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedd5351-cb7f-4c27-9ae0-60e835fd98fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8529969-b4c5-48fe-8b7e-d4391c93b416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:34 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Volume 1253ffbd-8442-46fa-860e-c9f310d09b27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1253ffbd-8442-46fa-860e-c9f310d09b27', 'volume_size': 1, 'image_id': 'a88d0559-7c40-4cca-9b04-6d7399edad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a88d0559-7c40-4cca-9b04-6d7399edad8b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '701fea62ebd7a2967b1e05ac5b79c18d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1ac061296f94a6e81f770ad8712e302', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3854ef5114c8bde1450cb0bee2e6622804de7852e738a21d0e22e32489ca56f2cec6fd0d037064b34d51a56dc5af04d216f2024671c3ca24358553bcfa17a87f', 'id': 'a88d0559-7c40-4cca-9b04-6d7399edad8b', 'created_at': datetime.datetime(2026, 7, 18, 4, 15, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a88d0559-7c40-4cca-9b04-6d7399edad8b/file', 'properties': {}}, 'image_service': } Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Trying to clone 1253ffbd-8442-46fa-860e-c9f310d09b27 from image a88d0559-7c40-4cca-9b04-6d7399edad8b at location (None, [{'url': 'file:///opt/stack/data/glance/images/a88d0559-7c40-4cca-9b04-6d7399edad8b', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 06:15:34 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Image download 0.00 MB at 0.00 MB/s Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e608a8-641c-4290-a9d1-bbb662df7bab]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:34 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD Jul 18 06:15:34 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:34 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:34 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD Jul 18 06:15:34 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:34 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD" returned: 1 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Temporary image a88d0559-7c40-4cca-9b04-6d7399edad8b is fetched for user 9c53f8a054394a6ba9ead177b9183098. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff17524b-2cca-4e18-baa8-4f8cb962572a]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:35 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD Jul 18 06:15:35 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:35 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:15:35 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:35 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD" returned: 0 in 0.311s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:35 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD Jul 18 06:15:35 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:35 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.248s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:15:35 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD" returned: 1 in 0.321s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1253ffbd-8442-46fa-860e-c9f310d09b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ac061296f94a6e81f770ad8712e302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:34Z,use_quota=True,user_id='9c53f8a054394a6ba9ead177b9183098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Creating volume 1253ffbd-8442-46fa-860e-c9f310d09b27 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:15:35 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:15:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:35 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 1073741824 Jul 18 06:15:35 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:36 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 1073741824" returned: 0 in 0.407s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:36 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 Jul 18 06:15:36 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:36 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27" returned: 0 in 0.232s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:15:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:36 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Attempting download of a88d0559-7c40-4cca-9b04-6d7399edad8b ((None, [{'url': 'file:///opt/stack/data/glance/images/a88d0559-7c40-4cca-9b04-6d7399edad8b', 'metadata': {}}])) to volume 1253ffbd-8442-46fa-860e-c9f310d09b27. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 06:15:36 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7015bf5a-3004-4cf0-82a1-f97022835a2f]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a88d0559-7c40-4cca-9b04-6d7399edad8b__f0kr5v1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:36 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a88d0559-7c40-4cca-9b04-6d7399edad8b__f0kr5v1 Jul 18 06:15:36 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:36 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a88d0559-7c40-4cca-9b04-6d7399edad8b__f0kr5v1" returned: 0 in 0.311s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a88d0559-7c40-4cca-9b04-6d7399edad8b__f0kr5v1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:36 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a88d0559-7c40-4cca-9b04-6d7399edad8b__f0kr5v1 Jul 18 06:15:36 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:36 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a88d0559-7c40-4cca-9b04-6d7399edad8b__f0kr5v1" returned: 1 in 0.315s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a88d0559-7c40-4cca-9b04-6d7399edad8b__f0kr5v1' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:15:37 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce87a35e-4bc8-4b29-9b96-610cd677d395]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:37 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD Jul 18 06:15:37 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:37 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD" returned: 0 in 0.311s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:37 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD Jul 18 06:15:37 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:37 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD" returned: 1 in 0.312s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:15:37 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] a88d0559-7c40-4cca-9b04-6d7399edad8b was raw, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 06:15:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:37 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 Jul 18 06:15:37 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:38 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27" returned: 0 in 0.439s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a88d0559-7c40-4cca-9b04-6d7399edad8b_lb0xz3_8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:15:38 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Converted 0.00 MB image at 0.00 MB/s Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:38 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 1G Jul 18 06:15:38 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:38 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 1G" returned: 0 in 0.301s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Downloaded image a88d0559-7c40-4cca-9b04-6d7399edad8b ((None, [{'url': 'file:///opt/stack/data/glance/images/a88d0559-7c40-4cca-9b04-6d7399edad8b', 'metadata': {}}])) to volume 1253ffbd-8442-46fa-860e-c9f310d09b27 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Temporary image a88d0559-7c40-4cca-9b04-6d7399edad8b for user 9c53f8a054394a6ba9ead177b9183098 is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Marking volume 1253ffbd-8442-46fa-860e-c9f310d09b27 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Copying metadata from image a88d0559-7c40-4cca-9b04-6d7399edad8b to 1253ffbd-8442-46fa-860e-c9f310d09b27. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Creating volume glance metadata for volume 1253ffbd-8442-46fa-860e-c9f310d09b27 backed by image a88d0559-7c40-4cca-9b04-6d7399edad8b with: {'image_id': 'a88d0559-7c40-4cca-9b04-6d7399edad8b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '701fea62ebd7a2967b1e05ac5b79c18d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8529969-b4c5-48fe-8b7e-d4391c93b416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1253ffbd-8442-46fa-860e-c9f310d09b27', 'volume_size': 1, 'image_id': 'a88d0559-7c40-4cca-9b04-6d7399edad8b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a88d0559-7c40-4cca-9b04-6d7399edad8b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '701fea62ebd7a2967b1e05ac5b79c18d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f1ac061296f94a6e81f770ad8712e302', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3854ef5114c8bde1450cb0bee2e6622804de7852e738a21d0e22e32489ca56f2cec6fd0d037064b34d51a56dc5af04d216f2024671c3ca24358553bcfa17a87f', 'id': 'a88d0559-7c40-4cca-9b04-6d7399edad8b', 'created_at': datetime.datetime(2026, 7, 18, 4, 15, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a88d0559-7c40-4cca-9b04-6d7399edad8b/file', 'properties': {}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01902d94-1a7f-4a49-89df-5f0eb8ba0982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:38 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Volume volume-1253ffbd-8442-46fa-860e-c9f310d09b27 (1253ffbd-8442-46fa-860e-c9f310d09b27): created successfully Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01902d94-1a7f-4a49-89df-5f0eb8ba0982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:38 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Flow 'volume_create_manager' (ae39fe2e-0f43-48a0-bf36-15a9f62fe66a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:38 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a94736da-4f2b-43c5-9e49-6ea9214f39f3 tempest-VolumeImageDependencyTests-984187560 None] Created volume successfully. Jul 18 06:15:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Acquiring lock "cinder-1253ffbd-8442-46fa-860e-c9f310d09b27-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Lock "cinder-1253ffbd-8442-46fa-860e-c9f310d09b27-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Acquiring lock "cinder-quobyte-1253ffbd-8442-46fa-860e-c9f310d09b27" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Lock "cinder-quobyte-1253ffbd-8442-46fa-860e-c9f310d09b27" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:39 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bed7fd-c26e-418f-a402-3e3a7fc619c5]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:39 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 Jul 18 06:15:39 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:39 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27" returned: 0 in 0.348s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:39 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27 Jul 18 06:15:39 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:39 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1253ffbd-8442-46fa-860e-c9f310d09b27" returned: 0 in 0.233s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Lock "cinder-quobyte-1253ffbd-8442-46fa-860e-c9f310d09b27" released by "delete_volume" :: held 0.619s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:39 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Created reservations ['4791f390-3844-4e99-8cae-7bdcb0e5a6d4', '6f465010-dadc-40bd-a62d-b1a2923f77db', 'ab2888a6-e894-41cc-85f1-844acdcd2303', 'b701542d-4e37-42ef-824b-ad18346f601b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:15:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:40 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:15:40 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:40 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.236s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:40 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:15:40 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Deleted volume successfully. Jul 18 06:15:40 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7821b064-d0cf-4463-a400-154e5fd6c547 tempest-VolumeImageDependencyTests-984187560 None] Lock "cinder-1253ffbd-8442-46fa-860e-c9f310d09b27-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:50 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=31,cinder:INSERT=12,cinder:UPDATE=35,cinder:DELETE=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:15:50 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=23,cinder:INSERT=14,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Flow 'volume_create_manager' (de04604f-f747-45f4-aac7-7e815749b3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b6bdca-bc94-49d7-9d8e-90ce8ce15ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b6bdca-bc94-49d7-9d8e-90ce8ce15ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-145334134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a358fac-556e-44cb-85eb-afd44a7c770d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c716df4e72fb476ab4f084de01661dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:52Z,use_quota=True,user_id='9558bb50c80244b48be8498612e7deff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f07f8b7-0c06-4059-ba8c-ab793098aced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f07f8b7-0c06-4059-ba8c-ab793098aced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab3f78c-e517-4480-819d-ed9dfb1f84cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab3f78c-e517-4480-819d-ed9dfb1f84cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a358fac-556e-44cb-85eb-afd44a7c770d', 'volume_name': 'volume-6a358fac-556e-44cb-85eb-afd44a7c770d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41673a6-230b-46c2-a945-a7ed251dafb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41673a6-230b-46c2-a945-a7ed251dafb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65abc32-405d-425f-97c7-8e4f6831d5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:51 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Volume 6a358fac-556e-44cb-85eb-afd44a7c770d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a358fac-556e-44cb-85eb-afd44a7c770d', 'volume_size': 1} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-145334134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a358fac-556e-44cb-85eb-afd44a7c770d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c716df4e72fb476ab4f084de01661dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:52Z,use_quota=True,user_id='9558bb50c80244b48be8498612e7deff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Creating volume 6a358fac-556e-44cb-85eb-afd44a7c770d {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:15:51 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:15:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:51 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d 1073741824 Jul 18 06:15:51 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Flow 'volume_create_manager' (2049de94-5b94-42de-8b1c-61fda46ffa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16088feb-953b-4fd4-b620-cb080b86b285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16088feb-953b-4fd4-b620-cb080b86b285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1232191454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fa74b3-2f21-450e-80ea-e0691c791418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2527da57824e868a23aa0d1086af57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:52Z,use_quota=True,user_id='c209b25ffea44c60a4cff05311acfeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d11e23-1771-4070-9dfa-ef81dd267bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d11e23-1771-4070-9dfa-ef81dd267bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff7abad-3380-4f3a-960c-9541e880ea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff7abad-3380-4f3a-960c-9541e880ea5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82fa74b3-2f21-450e-80ea-e0691c791418', 'volume_name': 'volume-82fa74b3-2f21-450e-80ea-e0691c791418', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa477e4-d7bf-4dad-ae22-89cdddb5a942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa477e4-d7bf-4dad-ae22-89cdddb5a942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01e8156-f4c5-4f15-be2e-009161ab81b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:52 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Volume 82fa74b3-2f21-450e-80ea-e0691c791418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82fa74b3-2f21-450e-80ea-e0691c791418', 'volume_size': 1} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:52 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d 1073741824" returned: 0 in 0.614s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Flow 'volume_create_manager' (7b5af12d-edd5-4596-be61-0570a02eda70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79117e36-2296-4dca-b396-a3947db7f648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79117e36-2296-4dca-b396-a3947db7f648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1281062376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8646776c-3b2d-48bb-ba9e-89a76f7eeb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2527da57824e868a23aa0d1086af57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:52Z,use_quota=True,user_id='c209b25ffea44c60a4cff05311acfeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b806a97b-c871-4838-912e-65ef3aa9da26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b806a97b-c871-4838-912e-65ef3aa9da26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bba953d-752f-4d29-a016-db6ae33e72ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bba953d-752f-4d29-a016-db6ae33e72ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8646776c-3b2d-48bb-ba9e-89a76f7eeb02', 'volume_name': 'volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99213df-2645-4daa-8d1d-bf54d082c7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99213df-2645-4daa-8d1d-bf54d082c7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f755f09-d12f-4e8b-888b-b3dba36f469d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:52 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Volume 8646776c-3b2d-48bb-ba9e-89a76f7eeb02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02', 'volume_size': 1} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:52 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d Jul 18 06:15:52 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:52 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d" returned: 0 in 0.293s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1232191454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fa74b3-2f21-450e-80ea-e0691c791418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2527da57824e868a23aa0d1086af57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:52Z,use_quota=True,user_id='c209b25ffea44c60a4cff05311acfeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Creating volume 82fa74b3-2f21-450e-80ea-e0691c791418 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:15:52 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-82fa74b3-2f21-450e-80ea-e0691c791418 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65abc32-405d-425f-97c7-8e4f6831d5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a358fac-556e-44cb-85eb-afd44a7c770d', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:52 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-82fa74b3-2f21-450e-80ea-e0691c791418 1073741824 Jul 18 06:15:52 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:52 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335d324e-2ce2-42e9-817b-68f35f48d2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Volume volume-6a358fac-556e-44cb-85eb-afd44a7c770d (6a358fac-556e-44cb-85eb-afd44a7c770d): created successfully Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335d324e-2ce2-42e9-817b-68f35f48d2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Flow 'volume_create_manager' (de04604f-f747-45f4-aac7-7e815749b3f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-698aebc5-a32b-403c-b0f0-8e016ae7f898 tempest-VolumeDependencyTests-521744950 None] Created volume successfully. Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Flow 'volume_create_manager' (a2205744-4aab-4c11-bdd3-c2b4a66fdc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abd5fa2-f09a-4405-9152-7f29b323c2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abd5fa2-f09a-4405-9152-7f29b323c2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037039842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b6b87791ff44cf8f1782bf332d938d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:53Z,use_quota=True,user_id='640a8eacf6a14879a2b815fe20ae5e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf8a41c-a0e5-42d0-bbeb-045de4eac04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf8a41c-a0e5-42d0-bbeb-045de4eac04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103161d4-9984-4bd0-8305-9e257c192ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103161d4-9984-4bd0-8305-9e257c192ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c', 'volume_name': 'volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24efbf15-a049-4a29-8d60-236c8070da9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24efbf15-a049-4a29-8d60-236c8070da9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2954b080-3a41-4837-b88e-c491558d783f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c', 'volume_size': 1} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Flow 'volume_create_manager' (feb2217c-7f7b-4ba3-b6ae-2c0a30663197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1157349f-b58c-419f-a1e2-8830f94a4a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1157349f-b58c-419f-a1e2-8830f94a4a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1374290122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae473e1a-0bbe-473a-8dd9-125a54106781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2527da57824e868a23aa0d1086af57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:53Z,use_quota=True,user_id='c209b25ffea44c60a4cff05311acfeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f370335-a8f2-4490-bd63-07d3c1c6f450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f370335-a8f2-4490-bd63-07d3c1c6f450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e665b1-8999-4333-9698-83c3329c5fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e665b1-8999-4333-9698-83c3329c5fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae473e1a-0bbe-473a-8dd9-125a54106781', 'volume_name': 'volume-ae473e1a-0bbe-473a-8dd9-125a54106781', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7f20b9-5494-4f34-81bd-6b80cf5d97b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca7f20b9-5494-4f34-81bd-6b80cf5d97b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36417767-e092-4a7e-8f1e-4a7480d2dbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Volume ae473e1a-0bbe-473a-8dd9-125a54106781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae473e1a-0bbe-473a-8dd9-125a54106781', 'volume_size': 1} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Flow 'volume_create_manager' (8cf59de0-652e-437b-b7b0-582285062bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b195e37e-0a88-48b7-b643-21c620d665dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b195e37e-0a88-48b7-b643-21c620d665dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1548109156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378765dc-9022-4e95-9265-1b1e012b511f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2527da57824e868a23aa0d1086af57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:53Z,use_quota=True,user_id='c209b25ffea44c60a4cff05311acfeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da02168-a133-4cf2-9c83-adb01fe4c6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da02168-a133-4cf2-9c83-adb01fe4c6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88e03f1-2fe6-4bf7-a10f-b4dfb670e7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88e03f1-2fe6-4bf7-a10f-b4dfb670e7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '378765dc-9022-4e95-9265-1b1e012b511f', 'volume_name': 'volume-378765dc-9022-4e95-9265-1b1e012b511f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21db4d6-5060-44b5-a834-ceea5deb9677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21db4d6-5060-44b5-a834-ceea5deb9677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e28b60c-84c6-452b-b0d8-2ba922e201d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Volume 378765dc-9022-4e95-9265-1b1e012b511f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-378765dc-9022-4e95-9265-1b1e012b511f', 'volume_size': 1} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-82fa74b3-2f21-450e-80ea-e0691c791418 1073741824" returned: 0 in 0.701s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-82fa74b3-2f21-450e-80ea-e0691c791418 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:53 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-82fa74b3-2f21-450e-80ea-e0691c791418 Jul 18 06:15:53 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Flow 'volume_create_manager' (cfc0d90d-d0e8-40d1-bd4d-85a042bdc293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74331b7-b9da-4b2c-8a4c-4467fb81bea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74331b7-b9da-4b2c-8a4c-4467fb81bea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105067730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b093bd-e818-4495-aabb-6e9abf9c6cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2527da57824e868a23aa0d1086af57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:54Z,use_quota=True,user_id='c209b25ffea44c60a4cff05311acfeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd103faf-77b4-4486-b1a6-7e8c9f14fa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd103faf-77b4-4486-b1a6-7e8c9f14fa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e97e908-f0f6-4ae0-9f06-006a9573e50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e97e908-f0f6-4ae0-9f06-006a9573e50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b093bd-e818-4495-aabb-6e9abf9c6cd3', 'volume_name': 'volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57882fcf-e420-47ca-bcd6-d7a2306a8556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57882fcf-e420-47ca-bcd6-d7a2306a8556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd29ed8-04d6-4e09-a1fa-c19e4ba738fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Volume d0b093bd-e818-4495-aabb-6e9abf9c6cd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3', 'volume_size': 1} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:53 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-82fa74b3-2f21-450e-80ea-e0691c791418" returned: 0 in 0.278s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.360s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1281062376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8646776c-3b2d-48bb-ba9e-89a76f7eeb02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2527da57824e868a23aa0d1086af57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:52Z,use_quota=True,user_id='c209b25ffea44c60a4cff05311acfeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Creating volume 8646776c-3b2d-48bb-ba9e-89a76f7eeb02 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:15:53 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e01e8156-f4c5-4f15-be2e-009161ab81b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82fa74b3-2f21-450e-80ea-e0691c791418', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:53 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02 1073741824 Jul 18 06:15:54 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca03e62-ca08-48a4-9ef6-70651494cf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Volume volume-82fa74b3-2f21-450e-80ea-e0691c791418 (82fa74b3-2f21-450e-80ea-e0691c791418): created successfully Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca03e62-ca08-48a4-9ef6-70651494cf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Flow 'volume_create_manager' (2049de94-5b94-42de-8b1c-61fda46ffa61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-67725102-bb69-4d76-b44c-e375d39471fb tempest-CreateVolumesFromImageTest-326328556 None] Created volume successfully. Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:54 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02 1073741824" returned: 0 in 0.510s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:54 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02 Jul 18 06:15:54 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:54 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02" returned: 0 in 0.254s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.496s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037039842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b6b87791ff44cf8f1782bf332d938d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:53Z,use_quota=True,user_id='640a8eacf6a14879a2b815fe20ae5e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Creating volume ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:15:54 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f755f09-d12f-4e8b-888b-b3dba36f469d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a033f5b4-b88c-4283-b2e1-f1f8243bff53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:54 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c 1073741824 Jul 18 06:15:54 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Volume volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02 (8646776c-3b2d-48bb-ba9e-89a76f7eeb02): created successfully Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a033f5b4-b88c-4283-b2e1-f1f8243bff53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Flow 'volume_create_manager' (7b5af12d-edd5-4596-be61-0570a02eda70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-336483af-b984-43f2-a2d3-76a34d8c32f7 tempest-CreateVolumesFromImageTest-326328556 None] Created volume successfully. Jul 18 06:15:55 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c 1073741824" returned: 0 in 0.489s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:55 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c Jul 18 06:15:55 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:55 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c" returned: 0 in 0.285s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.138s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1374290122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae473e1a-0bbe-473a-8dd9-125a54106781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2527da57824e868a23aa0d1086af57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:53Z,use_quota=True,user_id='c209b25ffea44c60a4cff05311acfeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Creating volume ae473e1a-0bbe-473a-8dd9-125a54106781 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:15:55 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae473e1a-0bbe-473a-8dd9-125a54106781 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:55 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae473e1a-0bbe-473a-8dd9-125a54106781 1073741824 Jul 18 06:15:55 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2954b080-3a41-4837-b88e-c491558d783f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe350716-a667-4603-8f26-4f3d8d7c5909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:55 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c (ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c): created successfully Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe350716-a667-4603-8f26-4f3d8d7c5909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:55 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Flow 'volume_create_manager' (a2205744-4aab-4c11-bdd3-c2b4a66fdc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:55 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b0c73b27-193a-4170-9712-0a2af3f5b98d tempest-CreateVolumesFromSnapshotTest-277013809 None] Created volume successfully. Jul 18 06:15:56 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae473e1a-0bbe-473a-8dd9-125a54106781 1073741824" returned: 0 in 0.544s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae473e1a-0bbe-473a-8dd9-125a54106781 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:56 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae473e1a-0bbe-473a-8dd9-125a54106781 Jul 18 06:15:56 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:56 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae473e1a-0bbe-473a-8dd9-125a54106781" returned: 0 in 0.264s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.830s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1548109156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=378765dc-9022-4e95-9265-1b1e012b511f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2527da57824e868a23aa0d1086af57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:53Z,use_quota=True,user_id='c209b25ffea44c60a4cff05311acfeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Creating volume 378765dc-9022-4e95-9265-1b1e012b511f {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:15:56 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-378765dc-9022-4e95-9265-1b1e012b511f 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36417767-e092-4a7e-8f1e-4a7480d2dbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae473e1a-0bbe-473a-8dd9-125a54106781', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:56 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-378765dc-9022-4e95-9265-1b1e012b511f 1073741824 Jul 18 06:15:56 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0b6e14-19d4-46c7-ac7e-3a57d080a7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Flow 'volume_create_manager' (7f5baaef-71a7-4c8a-978c-7fdcc87bc15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6316892d-39fe-46ae-b527-a3f14e9a006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:56 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Volume volume-ae473e1a-0bbe-473a-8dd9-125a54106781 (ae473e1a-0bbe-473a-8dd9-125a54106781): created successfully Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0b6e14-19d4-46c7-ac7e-3a57d080a7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Flow 'volume_create_manager' (feb2217c-7f7b-4ba3-b6ae-2c0a30663197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6316892d-39fe-46ae-b527-a3f14e9a006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b5b492a3d642fca09d6daeb0de5fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:56Z,use_quota=True,user_id='4d4b3b2f9af64460971e1b762350d433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eaf9c189-12f5-49ec-ad5e-98596e41d3c8),volume_type_id=eaf9c189-12f5-49ec-ad5e-98596e41d3c8)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0529d9-cb71-47a9-92bd-8f356f9235e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f0529d9-cb71-47a9-92bd-8f356f9235e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3734b367-9459-4a50-933c-296d17cf4e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 06:15:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0e0701aa-2fba-408a-9e27-645b69313b19 tempest-CreateVolumesFromImageTest-326328556 None] Created volume successfully. Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3734b367-9459-4a50-933c-296d17cf4e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c', 'volume_name': 'volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c', 'volume_size': 1, 'image_id': '703712fa-0a19-481a-8e1b-43531ed2778b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/703712fa-0a19-481a-8e1b-43531ed2778b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf2ea4aef34368ee0d9e59cf8638b066', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54b5b492a3d642fca09d6daeb0de5fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eeacd78be3618ba2aa306ed4e2fc529dfd08e8f370a4faa100b786f7ff74041f9dd1e6e37a864101b83907869451b4824846383bd52a7b6f98377c92f432fdf4', 'id': '703712fa-0a19-481a-8e1b-43531ed2778b', 'created_at': datetime.datetime(2026, 7, 18, 4, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 15, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/703712fa-0a19-481a-8e1b-43531ed2778b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7adce65a-01af-4858-9473-9f36c871122e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7adce65a-01af-4858-9473-9f36c871122e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be89e967-3cd6-4a3a-89a9-0984235a0a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:56 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Volume 6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c', 'volume_size': 1, 'image_id': '703712fa-0a19-481a-8e1b-43531ed2778b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/703712fa-0a19-481a-8e1b-43531ed2778b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf2ea4aef34368ee0d9e59cf8638b066', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54b5b492a3d642fca09d6daeb0de5fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eeacd78be3618ba2aa306ed4e2fc529dfd08e8f370a4faa100b786f7ff74041f9dd1e6e37a864101b83907869451b4824846383bd52a7b6f98377c92f432fdf4', 'id': '703712fa-0a19-481a-8e1b-43531ed2778b', 'created_at': datetime.datetime(2026, 7, 18, 4, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 15, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/703712fa-0a19-481a-8e1b-43531ed2778b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Trying to clone 6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c from image 703712fa-0a19-481a-8e1b-43531ed2778b at location (None, [{'url': 'file:///opt/stack/data/glance/images/703712fa-0a19-481a-8e1b-43531ed2778b', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 06:15:56 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-378765dc-9022-4e95-9265-1b1e012b511f 1073741824" returned: 0 in 0.445s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 06:15:56 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Image download 0.00 MB at 0.00 MB/s Jul 18 06:15:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-378765dc-9022-4e95-9265-1b1e012b511f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:56 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-378765dc-9022-4e95-9265-1b1e012b511f Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[92734b0e-2702-41f1-83e6-1d2f30b0d46e]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:57 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:57 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD Jul 18 06:15:57 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:57 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-378765dc-9022-4e95-9265-1b1e012b511f" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.306s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105067730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b093bd-e818-4495-aabb-6e9abf9c6cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2527da57824e868a23aa0d1086af57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:54Z,use_quota=True,user_id='c209b25ffea44c60a4cff05311acfeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Creating volume d0b093bd-e818-4495-aabb-6e9abf9c6cd3 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:15:57 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e28b60c-84c6-452b-b0d8-2ba922e201d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-378765dc-9022-4e95-9265-1b1e012b511f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:57 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3 1073741824 Jul 18 06:15:57 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6425153d-ea14-4f5f-a52e-30bc14f6d2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Volume volume-378765dc-9022-4e95-9265-1b1e012b511f (378765dc-9022-4e95-9265-1b1e012b511f): created successfully Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6425153d-ea14-4f5f-a52e-30bc14f6d2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Flow 'volume_create_manager' (8cf59de0-652e-437b-b7b0-582285062bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5b5b80da-8ef1-4329-966f-a910a4d87def tempest-CreateVolumesFromImageTest-326328556 None] Created volume successfully. Jul 18 06:15:57 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:57 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD Jul 18 06:15:57 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:57 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Temporary image 703712fa-0a19-481a-8e1b-43531ed2778b is fetched for user 4d4b3b2f9af64460971e1b762350d433. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 06:15:57 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3 1073741824" returned: 0 in 0.481s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa8f475-32ea-46d5-bfdb-624f5447675f]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:57 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3 Jul 18 06:15:57 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:57 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD Jul 18 06:15:57 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:58 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.749s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd29ed8-04d6-4e09-a1fa-c19e4ba738fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d28ec1-ce55-4abe-b221-9b63c763907b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] Creating offline snapshot feec6656-6956-4502-9ee7-eea8e92d927c of volume 6a358fac-556e-44cb-85eb-afd44a7c770d {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:15:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Volume volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3 (d0b093bd-e818-4495-aabb-6e9abf9c6cd3): created successfully Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5d28ec1-ce55-4abe-b221-9b63c763907b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:15:58 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Flow 'volume_create_manager' (cfc0d90d-d0e8-40d1-bd4d-85a042bdc293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[638f70e8-c810-4096-8b2c-44d81219faca]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a745012c-5823-4cbf-a40e-d0a324c30ad2 tempest-CreateVolumesFromImageTest-326328556 None] Created volume successfully. Jul 18 06:15:58 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d Jul 18 06:15:58 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:58 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD Jul 18 06:15:58 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "cinder-d0b093bd-e818-4495-aabb-6e9abf9c6cd3-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-d0b093bd-e818-4495-aabb-6e9abf9c6cd3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "cinder-quobyte-d0b093bd-e818-4495-aabb-6e9abf9c6cd3" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-quobyte-d0b093bd-e818-4495-aabb-6e9abf9c6cd3" acquired by "delete_volume" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8387cfd9-387d-49c2-8d83-9c60286f5545]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:58 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d" returned: 0 in 0.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:58 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD" returned: 1 in 0.443s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:58 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c 1G Jul 18 06:15:58 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:58 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3 Jul 18 06:15:58 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:58 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3" returned: 0 in 0.385s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:58 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3 Jul 18 06:15:58 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:58 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c 1G" returned: 0 in 0.409s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a358fac-556e-44cb-85eb-afd44a7c770d -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:58 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a358fac-556e-44cb-85eb-afd44a7c770d -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c Jul 18 06:15:58 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:59 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-d0b093bd-e818-4495-aabb-6e9abf9c6cd3" returned: 0 in 0.301s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-quobyte-d0b093bd-e818-4495-aabb-6e9abf9c6cd3" released by "delete_volume" :: held 0.752s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Created reservations ['3fb074d2-c984-4016-b6a5-9c4f559b6e73', '894c6eba-759d-4db9-b066-ce19b67e6d29', '2c48fa09-96d4-4c41-ad60-35c129ccac2a', '9a9474bb-e6d5-4c75-8cb2-0a7508a085ae'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:15:59 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a358fac-556e-44cb-85eb-afd44a7c770d -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c" returned: 0 in 0.335s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:59 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c is being set with open permissions: ugo+rw Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:59 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c Jul 18 06:15:59 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:59 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:15:59 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:59 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c" returned: 0 in 0.282s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "cinder-378765dc-9022-4e95-9265-1b1e012b511f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:59 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-378765dc-9022-4e95-9265-1b1e012b511f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.275s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:15:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Deleted volume successfully. Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-dae58833-4cbb-4b61-a24f-760465424ede tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-d0b093bd-e818-4495-aabb-6e9abf9c6cd3-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:15:59 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.info Jul 18 06:15:59 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "cinder-quobyte-378765dc-9022-4e95-9265-1b1e012b511f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-quobyte-378765dc-9022-4e95-9265-1b1e012b511f" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[930415a0-c244-4862-938c-051173700337]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-378765dc-9022-4e95-9265-1b1e012b511f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:59 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-378765dc-9022-4e95-9265-1b1e012b511f Jul 18 06:15:59 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:15:59 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.info" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:15:59 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.info is being set with open permissions: ugo+rw Jul 18 06:15:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:15:59 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.info Jul 18 06:15:59 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:00 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-378765dc-9022-4e95-9265-1b1e012b511f" returned: 0 in 0.369s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-378765dc-9022-4e95-9265-1b1e012b511f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:00 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-378765dc-9022-4e95-9265-1b1e012b511f Jul 18 06:16:00 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:00 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.info" returned: 0 in 0.245s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.711s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] Creating offline snapshot 47c1c12c-f972-4521-84f0-ed303f1925a1 of volume ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b8dc4a-af45-4549-8c4a-43d5f9beba7a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cd24cd29-dcdf-4cc0-ba77-da89bb3cac64 tempest-VolumeDependencyTests-521744950 None] Create snapshot completed successfully Jul 18 06:16:00 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c Jul 18 06:16:00 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:00 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-378765dc-9022-4e95-9265-1b1e012b511f" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-quobyte-378765dc-9022-4e95-9265-1b1e012b511f" released by "delete_volume" :: held 0.662s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Created reservations ['4fafdf33-47f6-478b-881c-aff4c6c91e07', 'ed830391-eac7-465d-b494-706b57d5f620', 'a3fb8e80-8160-41ff-a264-d9f2dcec8244', 'b9d873f3-855d-4488-ae33-336962c3ef6a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:00 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:00 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c" returned: 0 in 0.407s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:00 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:00 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 1G Jul 18 06:16:00 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "cinder-ae473e1a-0bbe-473a-8dd9-125a54106781-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:00 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.300s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-ae473e1a-0bbe-473a-8dd9-125a54106781-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Deleted volume successfully. Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-97d9d892-ddf7-42d5-b710-3188db0a2354 tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-378765dc-9022-4e95-9265-1b1e012b511f-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "cinder-quobyte-ae473e1a-0bbe-473a-8dd9-125a54106781" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-quobyte-ae473e1a-0bbe-473a-8dd9-125a54106781" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c339b3d-f350-40e2-9099-08c859c395d9]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae473e1a-0bbe-473a-8dd9-125a54106781 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:01 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae473e1a-0bbe-473a-8dd9-125a54106781 Jul 18 06:16:01 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:01 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 1G" returned: 0 in 0.539s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:01 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 Jul 18 06:16:01 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Flow 'volume_create_manager' (3889d4d4-fff9-4850-b737-fe71c3f50bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b846d3-1763-40f3-a110-ed5315e708e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b846d3-1763-40f3-a110-ed5315e708e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1849048720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82bf000-bf23-4e3e-9ee1-23035885815d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c716df4e72fb476ab4f084de01661dd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=feec6656-6956-4502-9ee7-eea8e92d927c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:01Z,use_quota=True,user_id='9558bb50c80244b48be8498612e7deff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab28ec3-4748-4b74-947f-80c024a7c139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab28ec3-4748-4b74-947f-80c024a7c139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf6f7ae-b5cb-4a3b-924a-c1da7115a750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf6f7ae-b5cb-4a3b-924a-c1da7115a750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f82bf000-bf23-4e3e-9ee1-23035885815d', 'volume_name': 'volume-f82bf000-bf23-4e3e-9ee1-23035885815d', 'volume_size': 1, 'snapshot_id': 'feec6656-6956-4502-9ee7-eea8e92d927c'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d588d1ff-9d49-4b79-8100-95be1a9d15d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d588d1ff-9d49-4b79-8100-95be1a9d15d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c808d09-e7a4-4dff-aca5-5d7fdee75612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:01 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Volume f82bf000-bf23-4e3e-9ee1-23035885815d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f82bf000-bf23-4e3e-9ee1-23035885815d', 'volume_size': 1, 'snapshot_id': 'feec6656-6956-4502-9ee7-eea8e92d927c'} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:01 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae473e1a-0bbe-473a-8dd9-125a54106781" returned: 0 in 0.458s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae473e1a-0bbe-473a-8dd9-125a54106781 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:01 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae473e1a-0bbe-473a-8dd9-125a54106781 Jul 18 06:16:01 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:01 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1" returned: 0 in 0.361s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:01 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 is being set with open permissions: ugo+rw Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:01 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 Jul 18 06:16:01 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:01 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae473e1a-0bbe-473a-8dd9-125a54106781" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-quobyte-ae473e1a-0bbe-473a-8dd9-125a54106781" released by "delete_volume" :: held 0.772s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Created reservations ['0f9cea7b-34d5-484f-99b2-131d5601d14e', '6f76775e-c773-464a-8152-e540e69240ec', 'aa551c5b-3e58-4709-a718-898990acf36d', 'dea658c3-2c26-4e9b-950e-1a973e9d6dc2'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:01 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:01 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:01 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:01 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.info Jul 18 06:16:01 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "cinder-8646776c-3b2d-48bb-ba9e-89a76f7eeb02-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-8646776c-3b2d-48bb-ba9e-89a76f7eeb02-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "cinder-quobyte-8646776c-3b2d-48bb-ba9e-89a76f7eeb02" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-quobyte-8646776c-3b2d-48bb-ba9e-89a76f7eeb02" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:02 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.307s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Deleted volume successfully. Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[364582ea-a4b4-42fa-8f9e-006f559eb287]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:02 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.info" returned: 0 in 0.281s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:02 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.info is being set with open permissions: ugo+rw Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3ccdf92e-bf96-4e28-aa45-616c10e65a8e tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-ae473e1a-0bbe-473a-8dd9-125a54106781-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:02 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.info Jul 18 06:16:02 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:02 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02 Jul 18 06:16:02 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:02 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.info" returned: 0 in 0.269s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.837s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b5b492a3d642fca09d6daeb0de5fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:15:56Z,use_quota=True,user_id='4d4b3b2f9af64460971e1b762350d433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eaf9c189-12f5-49ec-ad5e-98596e41d3c8),volume_type_id=eaf9c189-12f5-49ec-ad5e-98596e41d3c8)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Creating volume 6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:02 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:02 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c 1073741824 Jul 18 06:16:02 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:02 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-af7edb0c-804f-49c9-a3f7-c4c0fc4ed181 tempest-CreateVolumesFromSnapshotTest-277013809 None] Create snapshot completed successfully Jul 18 06:16:02 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02" returned: 0 in 0.381s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:02 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02 Jul 18 06:16:02 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:02 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8646776c-3b2d-48bb-ba9e-89a76f7eeb02" returned: 0 in 0.307s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-quobyte-8646776c-3b2d-48bb-ba9e-89a76f7eeb02" released by "delete_volume" :: held 0.745s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Created reservations ['d049f5ee-272b-4c2d-9085-b3f18a268243', 'fd392813-2a5c-4caa-be97-f7b0d11d1b64', 'a70f56d7-ed7c-48d4-97a0-3907af220856', '8ece7f21-4396-44d9-ab52-5cd5d4add0fb'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:02 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c 1073741824" returned: 0 in 0.506s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:02 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:02 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:03 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c Jul 18 06:16:03 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Flow 'volume_create_manager' (578e0dda-e73d-4043-8957-31c12a182ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bbf7d5-a4f8-4b65-9bbb-6d6b7c6598d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bbf7d5-a4f8-4b65-9bbb-6d6b7c6598d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1417194345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37e31dc-3ada-4151-b005-e54296c3cfa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b6b87791ff44cf8f1782bf332d938d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:03Z,use_quota=True,user_id='640a8eacf6a14879a2b815fe20ae5e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040a5084-dd73-454c-aa86-c307e7c9017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040a5084-dd73-454c-aa86-c307e7c9017d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf4ca77-dfb7-49d9-8c48-f69f6c84117c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaf4ca77-dfb7-49d9-8c48-f69f6c84117c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e37e31dc-3ada-4151-b005-e54296c3cfa6', 'volume_name': 'volume-e37e31dc-3ada-4151-b005-e54296c3cfa6', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4efd44-151f-46ca-8114-221ffb54965d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4efd44-151f-46ca-8114-221ffb54965d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3174809a-a940-406f-b767-29135970869b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume e37e31dc-3ada-4151-b005-e54296c3cfa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e37e31dc-3ada-4151-b005-e54296c3cfa6', 'volume_size': 1} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "cinder-82fa74b3-2f21-450e-80ea-e0691c791418-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:03 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:03 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.429s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c" returned: 0 in 0.392s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-82fa74b3-2f21-450e-80ea-e0691c791418-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.052s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Acquiring lock "cinder-quobyte-feec6656-6956-4502-9ee7-eea8e92d927c-f82bf000-bf23-4e3e-9ee1-23035885815d" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Deleted volume successfully. Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-263c2e6c-300e-43b6-891b-4f9303bd99f5 tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-8646776c-3b2d-48bb-ba9e-89a76f7eeb02-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Lock "cinder-quobyte-feec6656-6956-4502-9ee7-eea8e92d927c-f82bf000-bf23-4e3e-9ee1-23035885815d" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Creating volume f82bf000-bf23-4e3e-9ee1-23035885815d from snapshot feec6656-6956-4502-9ee7-eea8e92d927c {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Acquiring lock "cinder-quobyte-f82bf000-bf23-4e3e-9ee1-23035885815d" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Attempting download of 703712fa-0a19-481a-8e1b-43531ed2778b ((None, [{'url': 'file:///opt/stack/data/glance/images/703712fa-0a19-481a-8e1b-43531ed2778b', 'metadata': {}}])) to volume 6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "cinder-quobyte-82fa74b3-2f21-450e-80ea-e0691c791418" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Lock "cinder-quobyte-f82bf000-bf23-4e3e-9ee1-23035885815d" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] snapshot: feec6656-6956-4502-9ee7-eea8e92d927c, volume: f82bf000-bf23-4e3e-9ee1-23035885815d, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-quobyte-82fa74b3-2f21-450e-80ea-e0691c791418" acquired by "delete_volume" :: waited 0.056s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[956f518c-0fde-4dd6-b3d8-4f475906475a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f094ce2-1024-4644-b194-4dcf601914bf]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-82fa74b3-2f21-450e-80ea-e0691c791418 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8f2643-fabb-4972-9d79-4a7678b51c89]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_703712fa-0a19-481a-8e1b-43531ed2778b_455s4vfx {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Flow 'volume_create_manager' (ecbdc88c-df64-4e1d-99a7-591f2c1a4281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:03 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-82fa74b3-2f21-450e-80ea-e0691c791418 Jul 18 06:16:03 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:03 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c Jul 18 06:16:03 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd12688-c0d0-44f6-a03b-4d6f01c24405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd12688-c0d0-44f6-a03b-4d6f01c24405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-380520222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a763afc5-3e69-4ac1-809d-e44ee25fa850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b6b87791ff44cf8f1782bf332d938d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:04Z,use_quota=True,user_id='640a8eacf6a14879a2b815fe20ae5e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f025871-3f29-4963-969a-3d45d979611d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f025871-3f29-4963-969a-3d45d979611d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:03 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_703712fa-0a19-481a-8e1b-43531ed2778b_455s4vfx Jul 18 06:16:03 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7ff498-e0c4-4766-bea9-1474ce29f8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf7ff498-e0c4-4766-bea9-1474ce29f8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a763afc5-3e69-4ac1-809d-e44ee25fa850', 'volume_name': 'volume-a763afc5-3e69-4ac1-809d-e44ee25fa850', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b912d1-a13b-4d66-a882-14d392da6bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b912d1-a13b-4d66-a882-14d392da6bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da09c459-7d0d-4166-b153-a04c9cfa1630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:03 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume a763afc5-3e69-4ac1-809d-e44ee25fa850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a763afc5-3e69-4ac1-809d-e44ee25fa850', 'volume_size': 1} Jul 18 06:16:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:04 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:04 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_703712fa-0a19-481a-8e1b-43531ed2778b_455s4vfx" returned: 0 in 0.494s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_703712fa-0a19-481a-8e1b-43531ed2778b_455s4vfx {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c" returned: 0 in 0.553s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a358fac-556e-44cb-85eb-afd44a7c770d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e62c755-da26-41ee-b5b1-95d8a70728a5]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:04 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Flow 'volume_create_manager' (f3429bba-8d51-4966-9d63-6f2b0c4de624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab732715-d342-48f0-ae60-91f26f6cc7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-82fa74b3-2f21-450e-80ea-e0691c791418" returned: 0 in 0.612s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-82fa74b3-2f21-450e-80ea-e0691c791418 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:04 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_703712fa-0a19-481a-8e1b-43531ed2778b_455s4vfx Jul 18 06:16:04 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab732715-d342-48f0-ae60-91f26f6cc7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040021040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c523536-9d1e-451b-9d30-5783c443748c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b6b87791ff44cf8f1782bf332d938d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:04Z,use_quota=True,user_id='640a8eacf6a14879a2b815fe20ae5e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:04 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-82fa74b3-2f21-450e-80ea-e0691c791418 Jul 18 06:16:04 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2c51db-3a3e-4047-a474-7a667ddc691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2c51db-3a3e-4047-a474-7a667ddc691b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69ee0fe-5bb8-454d-9dcc-0bb2a1419004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69ee0fe-5bb8-454d-9dcc-0bb2a1419004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c523536-9d1e-451b-9d30-5783c443748c', 'volume_name': 'volume-5c523536-9d1e-451b-9d30-5783c443748c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7341bb27-eb29-4cec-b074-1db7668598d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7341bb27-eb29-4cec-b074-1db7668598d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a98adb-fe37-4fa5-95a3-71116b0057f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume 5c523536-9d1e-451b-9d30-5783c443748c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c523536-9d1e-451b-9d30-5783c443748c', 'volume_size': 1} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:04 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d Jul 18 06:16:04 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:04 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_703712fa-0a19-481a-8e1b-43531ed2778b_455s4vfx" returned: 1 in 0.414s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_703712fa-0a19-481a-8e1b-43531ed2778b_455s4vfx' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e756e7c3-aeec-4724-8964-4e719687736f]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:04 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-82fa74b3-2f21-450e-80ea-e0691c791418" returned: 0 in 0.396s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-quobyte-82fa74b3-2f21-450e-80ea-e0691c791418" released by "delete_volume" :: held 1.081s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:04 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d" returned: 0 in 0.511s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Path /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:04 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD Jul 18 06:16:04 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:04 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d Jul 18 06:16:04 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Flow 'volume_create_manager' (75a387dd-a4d8-45e7-85a9-56989de9edd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a35445-830f-4455-92e7-3108e7d2134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a35445-830f-4455-92e7-3108e7d2134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-220667618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e79d623-7098-45aa-8b57-f2d4e9f084b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b6b87791ff44cf8f1782bf332d938d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:05Z,use_quota=True,user_id='640a8eacf6a14879a2b815fe20ae5e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec779a6-655d-46c2-8d65-5262cce59eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec779a6-655d-46c2-8d65-5262cce59eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79549a72-b028-4a90-a732-93c01015cedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79549a72-b028-4a90-a732-93c01015cedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e79d623-7098-45aa-8b57-f2d4e9f084b4', 'volume_name': 'volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba33e87-65d2-4cde-b838-2023cb4f5ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba33e87-65d2-4cde-b838-2023cb4f5ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79ead3d-55af-409d-8101-e27768faef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume 8e79d623-7098-45aa-8b57-f2d4e9f084b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4', 'volume_size': 1} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Created reservations ['9591b27e-b9e3-48e7-b80b-39807d8a4dfb', 'c353563a-b93d-435f-a98b-5ff24991a082', '10dc9911-3750-49ff-8433-af96a8e2e100', 'eb1f8b9e-68e1-45f8-8ac4-8b210dab0d27'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:04 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:05 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:05 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:05 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD Jul 18 06:16:05 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Flow 'volume_create_manager' (d6b1ab61-0cdc-40b4-894c-a0c5e4102f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46de427-b621-4bba-baf6-6aa3eef8b37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46de427-b621-4bba-baf6-6aa3eef8b37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-863636469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce27fb1a-c142-491b-84d2-68f7f07ba157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b6b87791ff44cf8f1782bf332d938d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:05Z,use_quota=True,user_id='640a8eacf6a14879a2b815fe20ae5e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdcf354-4957-4b10-93f8-50cefa345933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fdcf354-4957-4b10-93f8-50cefa345933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2856e9-c2bc-41a6-931f-7cf74c6aa028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f2856e9-c2bc-41a6-931f-7cf74c6aa028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce27fb1a-c142-491b-84d2-68f7f07ba157', 'volume_name': 'volume-ce27fb1a-c142-491b-84d2-68f7f07ba157', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68791b50-bfeb-4813-8fcd-4cc84a0ad5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68791b50-bfeb-4813-8fcd-4cc84a0ad5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a134384-a39d-424b-95af-f898d0630a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:05 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume ce27fb1a-c142-491b-84d2-68f7f07ba157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce27fb1a-c142-491b-84d2-68f7f07ba157', 'volume_size': 1} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:05 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:05 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Deleted volume successfully. Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-2a1b2e52-efff-472f-92ba-f52a4d6ad481 tempest-CreateVolumesFromImageTest-326328556 None] Lock "cinder-82fa74b3-2f21-450e-80ea-e0691c791418-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:05 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD" returned: 1 in 0.550s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] 703712fa-0a19-481a-8e1b-43531ed2778b was raw, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 06:16:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:05 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c Jul 18 06:16:05 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:06 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c" returned: 0 in 1.234s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:06 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_703712fa-0a19-481a-8e1b-43531ed2778b_pi7v2vyldevstack@QuobyteHD, size 0.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:16:06 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Converted 0.00 MB image at 0.00 MB/s Jul 18 06:16:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:06 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c 1G Jul 18 06:16:06 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:07 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c 1G" returned: 0 in 0.929s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:07 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Downloaded image 703712fa-0a19-481a-8e1b-43531ed2778b ((None, [{'url': 'file:///opt/stack/data/glance/images/703712fa-0a19-481a-8e1b-43531ed2778b', 'metadata': {}}])) to volume 6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 06:16:07 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Temporary image 703712fa-0a19-481a-8e1b-43531ed2778b for user 4d4b3b2f9af64460971e1b762350d433 is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 06:16:07 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Marking volume 6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 06:16:07 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Copying metadata from image 703712fa-0a19-481a-8e1b-43531ed2778b to 6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 06:16:07 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Creating volume glance metadata for volume 6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c backed by image 703712fa-0a19-481a-8e1b-43531ed2778b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '703712fa-0a19-481a-8e1b-43531ed2778b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cf2ea4aef34368ee0d9e59cf8638b066', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 06:16:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be89e967-3cd6-4a3a-89a9-0984235a0a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c', 'volume_size': 1, 'image_id': '703712fa-0a19-481a-8e1b-43531ed2778b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/703712fa-0a19-481a-8e1b-43531ed2778b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cf2ea4aef34368ee0d9e59cf8638b066', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '54b5b492a3d642fca09d6daeb0de5fd0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'eeacd78be3618ba2aa306ed4e2fc529dfd08e8f370a4faa100b786f7ff74041f9dd1e6e37a864101b83907869451b4824846383bd52a7b6f98377c92f432fdf4', 'id': '703712fa-0a19-481a-8e1b-43531ed2778b', 'created_at': datetime.datetime(2026, 7, 18, 4, 15, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 15, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/703712fa-0a19-481a-8e1b-43531ed2778b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f894b0-603d-4cb7-8d78-97fb8c882cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Volume volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c (6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c): created successfully Jul 18 06:16:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f894b0-603d-4cb7-8d78-97fb8c882cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Flow 'volume_create_manager' (7f5baaef-71a7-4c8a-978c-7fdcc87bc15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7ee762fc-737e-4943-86ac-7f3fb65f49f0 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Created volume successfully. Jul 18 06:16:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Acquiring lock "cinder-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Lock "cinder-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Acquiring lock "cinder-quobyte-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Lock "cinder-quobyte-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c" acquired by "delete_volume" :: waited 0.056s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:08 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ea2d98-556a-4bf2-8570-1312b96b7f4f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:09 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c Jul 18 06:16:09 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:09 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c" returned: 0 in 0.867s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:09 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c Jul 18 06:16:09 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d" returned: 0 in 5.523s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[17974503-e8ef-4cd5-9ddd-42ef10049964]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:10 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c" returned: 0 in 0.566s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Lock "cinder-quobyte-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c" released by "delete_volume" :: held 1.515s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:10 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d Jul 18 06:16:10 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Created reservations ['2ac3f728-f31d-42e0-af0c-e09e6b2012dd', 'efc2e2aa-3550-4654-89bf-fdaa30e4ca85', '2a190c6f-3df8-4795-8c77-a6c28f0c4171', '6485685f-9250-4f01-bbad-b4e1f6a80750'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:10 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:10 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:10 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Deleted volume successfully. Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c11a5edf-3c16-4eee-b9f9-5d81d1d4e268 tempest-VolumeAndVolumeTypeFromImageTest-318755139 None] Lock "cinder-6c1a9c3c-ac1e-4733-be1a-9d665cda5a9c-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:10 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d" returned: 0 in 0.615s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:16:10 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Converted 1024.00 MB image at 185.36 MB/s Jul 18 06:16:10 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d is being set with open permissions: ugo+rw Jul 18 06:16:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:10 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d Jul 18 06:16:10 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:11 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d" returned: 0 in 0.277s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Lock "cinder-quobyte-f82bf000-bf23-4e3e-9ee1-23035885815d" released by "_copy_volume_from_snapshot" :: held 7.608s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Lock "cinder-quobyte-feec6656-6956-4502-9ee7-eea8e92d927c-f82bf000-bf23-4e3e-9ee1-23035885815d" released by "_create_volume_from_snapshot" :: held 7.666s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.715s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.837s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1417194345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e37e31dc-3ada-4151-b005-e54296c3cfa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b6b87791ff44cf8f1782bf332d938d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:03Z,use_quota=True,user_id='640a8eacf6a14879a2b815fe20ae5e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Creating volume e37e31dc-3ada-4151-b005-e54296c3cfa6 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:11 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e37e31dc-3ada-4151-b005-e54296c3cfa6 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:11 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e37e31dc-3ada-4151-b005-e54296c3cfa6 1073741824 Jul 18 06:16:11 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c808d09-e7a4-4dff-aca5-5d7fdee75612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f82bf000-bf23-4e3e-9ee1-23035885815d', 'volume_size': 1, 'snapshot_id': 'feec6656-6956-4502-9ee7-eea8e92d927c'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4994834c-7f93-4019-ac43-61c8808fa6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:11 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Volume volume-f82bf000-bf23-4e3e-9ee1-23035885815d (f82bf000-bf23-4e3e-9ee1-23035885815d): created successfully Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4994834c-7f93-4019-ac43-61c8808fa6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Flow 'volume_create_manager' (3889d4d4-fff9-4850-b737-fe71c3f50bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f2ade5fb-4b0b-47ce-ad37-7d4ab64ffbe6 tempest-VolumeDependencyTests-521744950 None] Created volume successfully. Jul 18 06:16:11 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e37e31dc-3ada-4151-b005-e54296c3cfa6 1073741824" returned: 0 in 0.530s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e37e31dc-3ada-4151-b005-e54296c3cfa6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:11 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e37e31dc-3ada-4151-b005-e54296c3cfa6 Jul 18 06:16:11 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:11 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e37e31dc-3ada-4151-b005-e54296c3cfa6" returned: 0 in 0.280s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.122s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-380520222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a763afc5-3e69-4ac1-809d-e44ee25fa850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b6b87791ff44cf8f1782bf332d938d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:04Z,use_quota=True,user_id='640a8eacf6a14879a2b815fe20ae5e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Creating volume a763afc5-3e69-4ac1-809d-e44ee25fa850 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:11 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a763afc5-3e69-4ac1-809d-e44ee25fa850 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3174809a-a940-406f-b767-29135970869b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e37e31dc-3ada-4151-b005-e54296c3cfa6', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:12 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a763afc5-3e69-4ac1-809d-e44ee25fa850 1073741824 Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cece080-2666-48d9-b94d-782eab24d2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:12 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume volume-e37e31dc-3ada-4151-b005-e54296c3cfa6 (e37e31dc-3ada-4151-b005-e54296c3cfa6): created successfully Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cece080-2666-48d9-b94d-782eab24d2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Flow 'volume_create_manager' (578e0dda-e73d-4043-8957-31c12a182ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b0ace9f1-17e3-4ffb-997f-477004ca8ae6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Created volume successfully. Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Acquiring lock "cinder-feec6656-6956-4502-9ee7-eea8e92d927c-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Lock "cinder-feec6656-6956-4502-9ee7-eea8e92d927c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Acquiring lock "cinder-quobyte-6a358fac-556e-44cb-85eb-afd44a7c770d" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Lock "cinder-quobyte-6a358fac-556e-44cb-85eb-afd44a7c770d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Acquiring lock "cinder-quobyte-feec6656-6956-4502-9ee7-eea8e92d927c" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Lock "cinder-quobyte-feec6656-6956-4502-9ee7-eea8e92d927c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Deleting offline snapshot feec6656-6956-4502-9ee7-eea8e92d927c of volume 6a358fac-556e-44cb-85eb-afd44a7c770d {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] snapshot_file for this snap is: volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6860dd-ba37-41d6-bc1e-926bd4517470]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:12 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a763afc5-3e69-4ac1-809d-e44ee25fa850 1073741824" returned: 0 in 0.619s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a763afc5-3e69-4ac1-809d-e44ee25fa850 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:12 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a763afc5-3e69-4ac1-809d-e44ee25fa850 Jul 18 06:16:12 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:12 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c Jul 18 06:16:12 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:12 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a763afc5-3e69-4ac1-809d-e44ee25fa850" returned: 0 in 0.348s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.740s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040021040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c523536-9d1e-451b-9d30-5783c443748c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b6b87791ff44cf8f1782bf332d938d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:04Z,use_quota=True,user_id='640a8eacf6a14879a2b815fe20ae5e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Creating volume 5c523536-9d1e-451b-9d30-5783c443748c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:13 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5c523536-9d1e-451b-9d30-5783c443748c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:13 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c" returned: 0 in 0.456s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a358fac-556e-44cb-85eb-afd44a7c770d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:16:13 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5c523536-9d1e-451b-9d30-5783c443748c 1073741824 Jul 18 06:16:13 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da09c459-7d0d-4166-b153-a04c9cfa1630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a763afc5-3e69-4ac1-809d-e44ee25fa850', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6349572-dfa0-4c9e-ae20-325acf9ff77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e30156-4708-4d15-b33e-c9f9bac0b2b1]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:13 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume volume-a763afc5-3e69-4ac1-809d-e44ee25fa850 (a763afc5-3e69-4ac1-809d-e44ee25fa850): created successfully Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6349572-dfa0-4c9e-ae20-325acf9ff77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Flow 'volume_create_manager' (ecbdc88c-df64-4e1d-99a7-591f2c1a4281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:13 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-32bd7612-530c-42ed-8234-a276eddd4c05 tempest-CreateVolumesFromSnapshotTest-277013809 None] Created volume successfully. Jul 18 06:16:13 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d Jul 18 06:16:13 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:13 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d" returned: 0 in 0.492s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:13 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5c523536-9d1e-451b-9d30-5783c443748c 1073741824" returned: 0 in 0.590s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:13 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c Jul 18 06:16:13 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5c523536-9d1e-451b-9d30-5783c443748c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:13 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5c523536-9d1e-451b-9d30-5783c443748c Jul 18 06:16:13 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:13 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5c523536-9d1e-451b-9d30-5783c443748c" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.147s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-220667618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e79d623-7098-45aa-8b57-f2d4e9f084b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b6b87791ff44cf8f1782bf332d938d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:05Z,use_quota=True,user_id='640a8eacf6a14879a2b815fe20ae5e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Creating volume 8e79d623-7098-45aa-8b57-f2d4e9f084b4 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:13 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a98adb-fe37-4fa5-95a3-71116b0057f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c523536-9d1e-451b-9d30-5783c443748c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:14 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4 1073741824 Jul 18 06:16:14 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256be52e-4161-4de3-978e-4bb0496d01f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:14 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:14 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume volume-5c523536-9d1e-451b-9d30-5783c443748c (5c523536-9d1e-451b-9d30-5783c443748c): created successfully Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256be52e-4161-4de3-978e-4bb0496d01f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Flow 'volume_create_manager' (f3429bba-8d51-4966-9d63-6f2b0c4de624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c" returned: 0 in 0.502s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:14 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c Jul 18 06:16:14 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-09958767-ca1e-442d-97b1-25107abcea2e tempest-CreateVolumesFromSnapshotTest-277013809 None] Created volume successfully. Jul 18 06:16:14 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d.feec6656-6956-4502-9ee7-eea8e92d927c" returned: 0 in 0.468s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Lock "cinder-quobyte-feec6656-6956-4502-9ee7-eea8e92d927c" released by "_delete_snapshot" :: held 2.110s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Lock "cinder-quobyte-6a358fac-556e-44cb-85eb-afd44a7c770d" released by "delete_snapshot" :: held 2.153s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Flow 'volume_create_manager' (c73d17dc-e018-4061-81a6-e6aaa4d79c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df42886-8638-466d-9374-f7a411d8d258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:14 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4df42886-8638-466d-9374-f7a411d8d258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a07cbd-f05f-4c52-94d9-e6e63c02b796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e8957f2cc74f11872306c751857c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:15Z,use_quota=True,user_id='1c672fa36ab04728b5a7bd25291088eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941e3f77-0cc3-4a78-8040-d5e1ea9e8a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941e3f77-0cc3-4a78-8040-d5e1ea9e8a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1290bc-ee9a-4848-9cac-2679c6e4e008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.image.glance [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Creating Keystone auth plugin from conf {{(pid=87750) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4 1073741824" returned: 0 in 0.746s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:14 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4 Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Created reservations ['a5bf0d79-1a0c-43ba-8470-c74250df71b9', 'd35e4bc5-f67b-4606-9359-352689ec0629', 'a147b926-6126-4896-927f-0f4a133487b9', '8bd1c1ef-255d-43b9-bfe0-1e4b69ae1e47'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:14 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Delete snapshot completed successfully. Jul 18 06:16:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0fd2a1d6-c42c-4783-8c2d-b343f5baa22c tempest-VolumeDependencyTests-521744950 None] Lock "cinder-feec6656-6956-4502-9ee7-eea8e92d927c-delete_snapshot" released by "delete_snapshot" :: held 2.426s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:15 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1290bc-ee9a-4848-9cac-2679c6e4e008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '93a07cbd-f05f-4c52-94d9-e6e63c02b796', 'volume_name': 'volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796', 'volume_size': 1, 'image_id': 'd62e3e53-397f-475e-967d-3f9c78eb53a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d62e3e53-397f-475e-967d-3f9c78eb53a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a2a381ae2829ba871b2d06f6b801d67', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b5e8957f2cc74f11872306c751857c62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae810e9f98d51478d123d2ea037ea436bbaee186f14dc91b86e9d127c06af969901f552bf7bd458b9e61e3940e30952776e4a3cbec2422d578b83ac3710c5c86', 'id': 'd62e3e53-397f-475e-967d-3f9c78eb53a2', 'created_at': datetime.datetime(2026, 7, 18, 4, 16, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 16, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d62e3e53-397f-475e-967d-3f9c78eb53a2/file', 'properties': {}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1269f361-1c49-49ef-84d5-16f2a4810d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1269f361-1c49-49ef-84d5-16f2a4810d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cae7d7b-36ff-412d-b28a-5dee83ab869b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:15 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Volume 93a07cbd-f05f-4c52-94d9-e6e63c02b796: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796', 'volume_size': 1, 'image_id': 'd62e3e53-397f-475e-967d-3f9c78eb53a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d62e3e53-397f-475e-967d-3f9c78eb53a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a2a381ae2829ba871b2d06f6b801d67', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b5e8957f2cc74f11872306c751857c62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae810e9f98d51478d123d2ea037ea436bbaee186f14dc91b86e9d127c06af969901f552bf7bd458b9e61e3940e30952776e4a3cbec2422d578b83ac3710c5c86', 'id': 'd62e3e53-397f-475e-967d-3f9c78eb53a2', 'created_at': datetime.datetime(2026, 7, 18, 4, 16, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 16, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d62e3e53-397f-475e-967d-3f9c78eb53a2/file', 'properties': {}}, 'image_service': } Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Trying to clone 93a07cbd-f05f-4c52-94d9-e6e63c02b796 from image d62e3e53-397f-475e-967d-3f9c78eb53a2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d62e3e53-397f-475e-967d-3f9c78eb53a2', 'metadata': {}}]). {{(pid=87750) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4" returned: 0 in 0.347s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.956s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-863636469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce27fb1a-c142-491b-84d2-68f7f07ba157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b6b87791ff44cf8f1782bf332d938d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:05Z,use_quota=True,user_id='640a8eacf6a14879a2b815fe20ae5e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Creating volume ce27fb1a-c142-491b-84d2-68f7f07ba157 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:15 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce27fb1a-c142-491b-84d2-68f7f07ba157 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:15 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce27fb1a-c142-491b-84d2-68f7f07ba157 1073741824 Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79ead3d-55af-409d-8101-e27768faef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:15 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bf1760-4ae7-41db-ad42-1ade83d9bc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:15 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4 (8e79d623-7098-45aa-8b57-f2d4e9f084b4): created successfully Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bf1760-4ae7-41db-ad42-1ade83d9bc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Flow 'volume_create_manager' (75a387dd-a4d8-45e7-85a9-56989de9edd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e26ac6d2-af51-4ae0-8599-714853c93f84 tempest-CreateVolumesFromSnapshotTest-277013809 None] Created volume successfully. Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 18 06:16:15 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Image download 0.00 MB at 0.00 MB/s Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[693c9173-3ee3-4bd8-af32-158f35985277]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:15 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD Jul 18 06:16:15 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:15 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Acquiring lock "cinder-6a358fac-556e-44cb-85eb-afd44a7c770d-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce27fb1a-c142-491b-84d2-68f7f07ba157 1073741824" returned: 0 in 0.567s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Lock "cinder-6a358fac-556e-44cb-85eb-afd44a7c770d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:15 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce27fb1a-c142-491b-84d2-68f7f07ba157 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Acquiring lock "cinder-quobyte-6a358fac-556e-44cb-85eb-afd44a7c770d" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:15 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce27fb1a-c142-491b-84d2-68f7f07ba157 Jul 18 06:16:15 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Lock "cinder-quobyte-6a358fac-556e-44cb-85eb-afd44a7c770d" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd06d6f-c2dc-4c85-98be-4db9a55618f9]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:15 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD Jul 18 06:16:15 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:15 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d Jul 18 06:16:15 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:16 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce27fb1a-c142-491b-84d2-68f7f07ba157" returned: 0 in 0.281s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a134384-a39d-424b-95af-f898d0630a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce27fb1a-c142-491b-84d2-68f7f07ba157', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2c4c77-d867-4cfe-aa68-194aec04bb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Volume volume-ce27fb1a-c142-491b-84d2-68f7f07ba157 (ce27fb1a-c142-491b-84d2-68f7f07ba157): created successfully Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2c4c77-d867-4cfe-aa68-194aec04bb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Flow 'volume_create_manager' (d6b1ab61-0cdc-40b4-894c-a0c5e4102f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3273be0f-273c-44e3-8edf-8d1ee8c4cef4 tempest-CreateVolumesFromSnapshotTest-277013809 None] Created volume successfully. Jul 18 06:16:16 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD" returned: 1 in 0.409s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Temporary image d62e3e53-397f-475e-967d-3f9c78eb53a2 is fetched for user 1c672fa36ab04728b5a7bd25291088eb. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2a877e-3eb7-4178-af6d-0fad498fbe85]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:16 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d" returned: 0 in 0.407s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:16 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d Jul 18 06:16:16 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:16 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD Jul 18 06:16:16 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Flow 'volume_create_manager' (dd1a7249-d5a7-4ec2-8e0f-52b32cac92c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4652ad63-7abc-43a7-b439-114555525813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4652ad63-7abc-43a7-b439-114555525813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1889896821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7287935b-f64a-4840-8eb1-dafeaaaa9122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864bdaa793cf40a68a672bd83a75f460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:16Z,use_quota=True,user_id='509637e6dde845319dbeb27fde5e6106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0f7fcf-7610-4546-824b-16966ee1f289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0f7fcf-7610-4546-824b-16966ee1f289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8e975c-8d0c-4e0c-b50f-b83114d56874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:16 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8e975c-8d0c-4e0c-b50f-b83114d56874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7287935b-f64a-4840-8eb1-dafeaaaa9122', 'volume_name': 'volume-7287935b-f64a-4840-8eb1-dafeaaaa9122', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b1c552-c2fa-4c10-9a5f-c7014fa269d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b1c552-c2fa-4c10-9a5f-c7014fa269d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a35468-2b24-4c40-ac50-0f34099d82cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume 7287935b-f64a-4840-8eb1-dafeaaaa9122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7287935b-f64a-4840-8eb1-dafeaaaa9122', 'volume_size': 1} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1889896821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7287935b-f64a-4840-8eb1-dafeaaaa9122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864bdaa793cf40a68a672bd83a75f460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:16Z,use_quota=True,user_id='509637e6dde845319dbeb27fde5e6106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Creating volume 7287935b-f64a-4840-8eb1-dafeaaaa9122 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:16 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:16 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7287935b-f64a-4840-8eb1-dafeaaaa9122 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-6a358fac-556e-44cb-85eb-afd44a7c770d" returned: 0 in 0.379s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:16 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7287935b-f64a-4840-8eb1-dafeaaaa9122 1073741824 Jul 18 06:16:16 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Lock "cinder-quobyte-6a358fac-556e-44cb-85eb-afd44a7c770d" released by "delete_volume" :: held 0.872s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:16 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD Jul 18 06:16:16 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Created reservations ['c48a5015-0ec5-4fd2-a40d-813a2b9ec19e', '027256b0-e8ea-4748-ab2b-70852780786a', 'e7a5e085-3203-4666-8ff2-51daf929031e', '368ff3b3-b8a2-453c-ae95-ae7f779a0d0f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-ce27fb1a-c142-491b-84d2-68f7f07ba157-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-ce27fb1a-c142-491b-84d2-68f7f07ba157-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:16 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:16 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-quobyte-ce27fb1a-c142-491b-84d2-68f7f07ba157" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-ce27fb1a-c142-491b-84d2-68f7f07ba157" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1baf18e-6e8c-4070-bd5c-7c181b5d7dbc]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce27fb1a-c142-491b-84d2-68f7f07ba157 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:17 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD" returned: 1 in 0.429s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:17 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:17 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce27fb1a-c142-491b-84d2-68f7f07ba157 Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7287935b-f64a-4840-8eb1-dafeaaaa9122 1073741824" returned: 0 in 0.506s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:17 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7287935b-f64a-4840-8eb1-dafeaaaa9122 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:17 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7287935b-f64a-4840-8eb1-dafeaaaa9122 Jul 18 06:16:17 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:17 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.285s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Deleted volume successfully. Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-c229068c-bb99-48da-8860-2e166bb6555f tempest-VolumeDependencyTests-521744950 None] Lock "cinder-6a358fac-556e-44cb-85eb-afd44a7c770d-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:17 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce27fb1a-c142-491b-84d2-68f7f07ba157" returned: 0 in 0.401s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce27fb1a-c142-491b-84d2-68f7f07ba157 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:17 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7287935b-f64a-4840-8eb1-dafeaaaa9122" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:17 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce27fb1a-c142-491b-84d2-68f7f07ba157 Jul 18 06:16:17 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a07cbd-f05f-4c52-94d9-e6e63c02b796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e8957f2cc74f11872306c751857c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:15Z,use_quota=True,user_id='1c672fa36ab04728b5a7bd25291088eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Creating volume 93a07cbd-f05f-4c52-94d9-e6e63c02b796 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:17 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a35468-2b24-4c40-ac50-0f34099d82cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7287935b-f64a-4840-8eb1-dafeaaaa9122', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:17 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 1073741824 Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c146e87-b03f-4b2a-8fa8-ac53f9a75e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:17 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:17 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume volume-7287935b-f64a-4840-8eb1-dafeaaaa9122 (7287935b-f64a-4840-8eb1-dafeaaaa9122): created successfully Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c146e87-b03f-4b2a-8fa8-ac53f9a75e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Flow 'volume_create_manager' (dd1a7249-d5a7-4ec2-8e0f-52b32cac92c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5339cb87-579d-4dc4-bd0e-459293c04a6e tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Created volume successfully. Jul 18 06:16:17 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ce27fb1a-c142-491b-84d2-68f7f07ba157" returned: 0 in 0.276s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-ce27fb1a-c142-491b-84d2-68f7f07ba157" released by "delete_volume" :: held 0.722s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Created reservations ['0dbb675f-ccbd-420d-89f2-058a11baf191', '570e08f9-756b-4bd1-93c9-4d15d73709ad', 'aed7fbc0-993e-4cf5-80c1-42ac330c90e7', '966885ad-68d9-43c8-bf4c-19539b64713b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:17 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:17 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:17 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 1073741824" returned: 0 in 0.452s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Acquiring lock "cinder-f82bf000-bf23-4e3e-9ee1-23035885815d-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:18 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 Jul 18 06:16:18 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Lock "cinder-f82bf000-bf23-4e3e-9ee1-23035885815d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Acquiring lock "cinder-quobyte-f82bf000-bf23-4e3e-9ee1-23035885815d" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-8e79d623-7098-45aa-8b57-f2d4e9f084b4-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Lock "cinder-quobyte-f82bf000-bf23-4e3e-9ee1-23035885815d" acquired by "delete_volume" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-8e79d623-7098-45aa-8b57-f2d4e9f084b4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:18 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07d93a9-70bc-4015-b46d-f511898104aa]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.334s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Deleted volume successfully. Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-quobyte-8e79d623-7098-45aa-8b57-f2d4e9f084b4" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-938b45cb-5e3d-4fd3-8f0b-17a2a68c3b5f tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-ce27fb1a-c142-491b-84d2-68f7f07ba157-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-8e79d623-7098-45aa-8b57-f2d4e9f084b4" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[64839cb0-1d61-4687-9d30-591ea1d65a72]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:18 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d Jul 18 06:16:18 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:18 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Attempting download of d62e3e53-397f-475e-967d-3f9c78eb53a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/d62e3e53-397f-475e-967d-3f9c78eb53a2', 'metadata': {}}])) to volume 93a07cbd-f05f-4c52-94d9-e6e63c02b796. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 18 06:16:18 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4 Jul 18 06:16:18 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2d425f-5a21-415f-aaff-cf99bb66ae1b]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d62e3e53-397f-475e-967d-3f9c78eb53a2_tsbnm5c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:18 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d62e3e53-397f-475e-967d-3f9c78eb53a2_tsbnm5c6 Jul 18 06:16:18 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:18 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d" returned: 0 in 0.439s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:18 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d Jul 18 06:16:18 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:18 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4" returned: 0 in 0.442s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:18 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4 Jul 18 06:16:18 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:18 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d62e3e53-397f-475e-967d-3f9c78eb53a2_tsbnm5c6" returned: 0 in 0.367s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d62e3e53-397f-475e-967d-3f9c78eb53a2_tsbnm5c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:18 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-f82bf000-bf23-4e3e-9ee1-23035885815d" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Lock "cinder-quobyte-f82bf000-bf23-4e3e-9ee1-23035885815d" released by "delete_volume" :: held 0.798s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:18 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d62e3e53-397f-475e-967d-3f9c78eb53a2_tsbnm5c6 Jul 18 06:16:18 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Created reservations ['b015f124-5a27-4d60-82a4-819ff8728ea2', '328d7224-7fdb-45f9-996f-d4fcdbbd91e9', '16999e7c-07f3-4d4b-8a42-c00e8c53cfcc', '9bf29874-aff4-45b5-a52d-1212266c613b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:19 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8e79d623-7098-45aa-8b57-f2d4e9f084b4" returned: 0 in 0.328s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-8e79d623-7098-45aa-8b57-f2d4e9f084b4" released by "delete_volume" :: held 0.816s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Created reservations ['309aa2ad-6119-447a-b18a-76cc0ef3781e', 'df786850-cfa4-459c-9e2f-66a0d9f8454a', '00b3a0c3-dd26-4ed8-9f62-6d3210a5b28d', '8d4785ad-ac53-4f19-bd85-824ad625b41d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:19 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:19 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:19 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Flow 'volume_create_manager' (72d93181-2c62-41f5-ab07-04fc1f0b339d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770f81e3-8417-464b-9ee7-69fba604cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d62e3e53-397f-475e-967d-3f9c78eb53a2_tsbnm5c6" returned: 1 in 0.468s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d62e3e53-397f-475e-967d-3f9c78eb53a2_tsbnm5c6' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3aec9e-beb9-4132-a5ac-172ac35dafe1]: (4, 'raw') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770f81e3-8417-464b-9ee7-69fba604cc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1184400157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf836c38-02c7-4ee0-a9b1-89ad282282ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864bdaa793cf40a68a672bd83a75f460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:19Z,use_quota=True,user_id='509637e6dde845319dbeb27fde5e6106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6c82a6-8133-45bc-b8db-093eb7cb6963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6c82a6-8133-45bc-b8db-093eb7cb6963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3457d8c4-220f-4576-a642-a77fcc462103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3457d8c4-220f-4576-a642-a77fcc462103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf836c38-02c7-4ee0-a9b1-89ad282282ef', 'volume_name': 'volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e2adaf-4018-4ff6-a5b9-1b8a10b25835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e2adaf-4018-4ff6-a5b9-1b8a10b25835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4eed5b-e218-4024-9894-ccbb76779a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:19 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume cf836c38-02c7-4ee0-a9b1-89ad282282ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef', 'volume_size': 1} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1184400157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf836c38-02c7-4ee0-a9b1-89ad282282ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864bdaa793cf40a68a672bd83a75f460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:19Z,use_quota=True,user_id='509637e6dde845319dbeb27fde5e6106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Creating volume cf836c38-02c7-4ee0-a9b1-89ad282282ef {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:19 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:19 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD Jul 18 06:16:19 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:19 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef 1073741824 Jul 18 06:16:19 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:19 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.455s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Deleted volume successfully. Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:19 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:19 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD" returned: 0 in 0.487s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:19 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4edb8e42-e170-406b-bc55-f130b931c1fb tempest-VolumeDependencyTests-521744950 None] Lock "cinder-f82bf000-bf23-4e3e-9ee1-23035885815d-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:19 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD Jul 18 06:16:19 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Flow 'volume_create_manager' (ebfda284-c8f3-4db2-aa29-a27a00202c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b823da5e-d0cc-40a3-9f50-012636727aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b823da5e-d0cc-40a3-9f50-012636727aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1152986706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4cc851-bfff-4435-8711-317768042616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864bdaa793cf40a68a672bd83a75f460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:20Z,use_quota=True,user_id='509637e6dde845319dbeb27fde5e6106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8802da7f-ed19-4cfa-8d00-3070703669f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8802da7f-ed19-4cfa-8d00-3070703669f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718664fa-8f18-4d4a-8e0c-abee1a067d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (718664fa-8f18-4d4a-8e0c-abee1a067d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb4cc851-bfff-4435-8711-317768042616', 'volume_name': 'volume-bb4cc851-bfff-4435-8711-317768042616', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5233af97-9446-475d-be77-d8cf10d3b054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5233af97-9446-475d-be77-d8cf10d3b054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf58033-6e54-4162-b5d1-cbc18ebad437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume bb4cc851-bfff-4435-8711-317768042616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb4cc851-bfff-4435-8711-317768042616', 'volume_size': 1} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:20 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.566s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:20 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Deleted volume successfully. Jul 18 06:16:20 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD" returned: 1 in 0.546s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] d62e3e53-397f-475e-967d-3f9c78eb53a2 was raw, converting to qcow2 {{(pid=87750) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 18 06:16:20 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fec0268a-2f54-4e9f-a888-035a35f47c43 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-8e79d623-7098-45aa-8b57-f2d4e9f084b4-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef 1073741824" returned: 0 in 0.921s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:20 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 Jul 18 06:16:20 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Flow 'volume_create_manager' (a7677e94-5099-4bdd-ae2f-1eed692a00f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b87ee6-791d-4376-a935-afc616f64bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:20 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef Jul 18 06:16:20 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b87ee6-791d-4376-a935-afc616f64bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-73955888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af07eafd-0eca-40c7-8fed-a09304719f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864bdaa793cf40a68a672bd83a75f460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:20Z,use_quota=True,user_id='509637e6dde845319dbeb27fde5e6106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49d1e51-993f-4a42-8209-ba91161ef11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49d1e51-993f-4a42-8209-ba91161ef11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6eb2791-15fb-4c9d-9130-34a40d37d734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6eb2791-15fb-4c9d-9130-34a40d37d734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af07eafd-0eca-40c7-8fed-a09304719f19', 'volume_name': 'volume-af07eafd-0eca-40c7-8fed-a09304719f19', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447dc2fb-c73f-497f-b253-5cf7dde37f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447dc2fb-c73f-497f-b253-5cf7dde37f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d12290b-17bd-429f-a18d-aa82af9224c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume af07eafd-0eca-40c7-8fed-a09304719f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af07eafd-0eca-40c7-8fed-a09304719f19', 'volume_size': 1} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-5c523536-9d1e-451b-9d30-5783c443748c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-5c523536-9d1e-451b-9d30-5783c443748c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-quobyte-5c523536-9d1e-451b-9d30-5783c443748c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-5c523536-9d1e-451b-9d30-5783c443748c" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b63d2ba-6fbc-46f4-85f6-8899590ad8e8]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5c523536-9d1e-451b-9d30-5783c443748c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:20 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef" returned: 0 in 0.484s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.808s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1152986706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb4cc851-bfff-4435-8711-317768042616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864bdaa793cf40a68a672bd83a75f460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:20Z,use_quota=True,user_id='509637e6dde845319dbeb27fde5e6106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Creating volume bb4cc851-bfff-4435-8711-317768042616 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:20 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bb4cc851-bfff-4435-8711-317768042616 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:20 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5c523536-9d1e-451b-9d30-5783c443748c Jul 18 06:16:20 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e4eed5b-e218-4024-9894-ccbb76779a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:21 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bb4cc851-bfff-4435-8711-317768042616 1073741824 Jul 18 06:16:21 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd752eea-214b-43c4-9c00-c3bf957ac49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef (cf836c38-02c7-4ee0-a9b1-89ad282282ef): created successfully Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd752eea-214b-43c4-9c00-c3bf957ac49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Flow 'volume_create_manager' (72d93181-2c62-41f5-ab07-04fc1f0b339d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0ca37d6d-c86e-4ffd-9d7a-9c6715e01194 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Created volume successfully. Jul 18 06:16:21 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796" returned: 0 in 0.876s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d62e3e53-397f-475e-967d-3f9c78eb53a2__x7v_5y8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:16:21 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Converted 0.00 MB image at 0.00 MB/s Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:21 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 1G Jul 18 06:16:21 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Flow 'volume_create_manager' (22f4b4a5-7848-47f6-ae8b-8e2ad317c2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af8ec8c-b587-4580-bab2-4fe29ac86b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af8ec8c-b587-4580-bab2-4fe29ac86b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-598181318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf952a4-afb0-470d-b62b-a14c1041e3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864bdaa793cf40a68a672bd83a75f460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:21Z,use_quota=True,user_id='509637e6dde845319dbeb27fde5e6106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088ccd17-a185-4c72-ab43-56ddd15e8951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088ccd17-a185-4c72-ab43-56ddd15e8951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:21 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1b33b6-9fec-432b-a2ec-7fe113e5e287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1b33b6-9fec-432b-a2ec-7fe113e5e287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddf952a4-afb0-470d-b62b-a14c1041e3b8', 'volume_name': 'volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fdc2ed-cb41-4336-bcf1-96f1bbb79395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fdc2ed-cb41-4336-bcf1-96f1bbb79395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfb27e2-0ba4-4489-861f-a34b0c1152ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume ddf952a4-afb0-470d-b62b-a14c1041e3b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8', 'volume_size': 1} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5c523536-9d1e-451b-9d30-5783c443748c" returned: 0 in 0.758s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5c523536-9d1e-451b-9d30-5783c443748c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:21 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5c523536-9d1e-451b-9d30-5783c443748c Jul 18 06:16:21 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Flow 'volume_create_manager' (cb9f4dd2-7073-4fbd-bb51-1ae2f184954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a9ee9d-9ba7-43fc-b516-c992ae6d52cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a9ee9d-9ba7-43fc-b516-c992ae6d52cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-932556643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864bdaa793cf40a68a672bd83a75f460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:22Z,use_quota=True,user_id='509637e6dde845319dbeb27fde5e6106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49867074-110c-4ce0-a01e-d72fae9de8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49867074-110c-4ce0-a01e-d72fae9de8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c9951b-45a3-4b20-a40b-96d002ff2c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2c9951b-45a3-4b20-a40b-96d002ff2c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72', 'volume_name': 'volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aeeda3b-137d-4612-91f1-af1c442717a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aeeda3b-137d-4612-91f1-af1c442717a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:21 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f8fcd6-52f4-460a-876a-63988ce253c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume 1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72', 'volume_size': 1} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bb4cc851-bfff-4435-8711-317768042616 1073741824" returned: 0 in 0.822s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:21 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 1G" returned: 0 in 0.598s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Downloaded image d62e3e53-397f-475e-967d-3f9c78eb53a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/d62e3e53-397f-475e-967d-3f9c78eb53a2', 'metadata': {}}])) to volume 93a07cbd-f05f-4c52-94d9-e6e63c02b796 successfully. {{(pid=87750) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Temporary image d62e3e53-397f-475e-967d-3f9c78eb53a2 for user 1c672fa36ab04728b5a7bd25291088eb is deleted. {{(pid=87750) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.volume_utils [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Marking volume 93a07cbd-f05f-4c52-94d9-e6e63c02b796 as bootable. {{(pid=87750) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bb4cc851-bfff-4435-8711-317768042616 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Copying metadata from image d62e3e53-397f-475e-967d-3f9c78eb53a2 to 93a07cbd-f05f-4c52-94d9-e6e63c02b796. {{(pid=87750) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Creating volume glance metadata for volume 93a07cbd-f05f-4c52-94d9-e6e63c02b796 backed by image d62e3e53-397f-475e-967d-3f9c78eb53a2 with: {'image_id': 'd62e3e53-397f-475e-967d-3f9c78eb53a2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3a2a381ae2829ba871b2d06f6b801d67', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87750) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 18 06:16:21 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bb4cc851-bfff-4435-8711-317768042616 Jul 18 06:16:21 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:21 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5c523536-9d1e-451b-9d30-5783c443748c" returned: 0 in 0.382s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-5c523536-9d1e-451b-9d30-5783c443748c" released by "delete_volume" :: held 1.209s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cae7d7b-36ff-412d-b28a-5dee83ab869b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796', 'volume_size': 1, 'image_id': 'd62e3e53-397f-475e-967d-3f9c78eb53a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d62e3e53-397f-475e-967d-3f9c78eb53a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3a2a381ae2829ba871b2d06f6b801d67', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b5e8957f2cc74f11872306c751857c62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae810e9f98d51478d123d2ea037ea436bbaee186f14dc91b86e9d127c06af969901f552bf7bd458b9e61e3940e30952776e4a3cbec2422d578b83ac3710c5c86', 'id': 'd62e3e53-397f-475e-967d-3f9c78eb53a2', 'created_at': datetime.datetime(2026, 7, 18, 4, 16, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 18, 4, 16, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d62e3e53-397f-475e-967d-3f9c78eb53a2/file', 'properties': {}}, 'image_service': }' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074fdc16-51fe-44af-97e0-d7489e139691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:21 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Volume volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 (93a07cbd-f05f-4c52-94d9-e6e63c02b796): created successfully Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074fdc16-51fe-44af-97e0-d7489e139691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:21 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Flow 'volume_create_manager' (c73d17dc-e018-4061-81a6-e6aaa4d79c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4fc46da6-28af-4e9c-9dfd-84191efb3646 tempest-VolumeImageDependencyTests-1820167632 None] Created volume successfully. Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Created reservations ['28ade004-4e19-42f0-9f1a-7c694cd2e57d', 'cf56ebdb-79c2-40cd-b90f-69f721b7c45e', '3fa63752-cbde-471d-b5a5-aa617a703446', 'daff031f-edc0-4c2d-a6b4-e23f5549f825'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:22 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bb4cc851-bfff-4435-8711-317768042616" returned: 0 in 0.285s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-73955888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af07eafd-0eca-40c7-8fed-a09304719f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864bdaa793cf40a68a672bd83a75f460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:20Z,use_quota=True,user_id='509637e6dde845319dbeb27fde5e6106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Creating volume af07eafd-0eca-40c7-8fed-a09304719f19 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:22 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af07eafd-0eca-40c7-8fed-a09304719f19 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:22 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af07eafd-0eca-40c7-8fed-a09304719f19 1073741824 Jul 18 06:16:22 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf58033-6e54-4162-b5d1-cbc18ebad437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb4cc851-bfff-4435-8711-317768042616', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81b96df-2b84-419f-bc7e-4a354c3e3432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:22 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:22 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:22 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume volume-bb4cc851-bfff-4435-8711-317768042616 (bb4cc851-bfff-4435-8711-317768042616): created successfully Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81b96df-2b84-419f-bc7e-4a354c3e3432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Flow 'volume_create_manager' (ebfda284-c8f3-4db2-aa29-a27a00202c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-8ba0612e-9036-4b03-b653-061725803ad2 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Created volume successfully. Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Acquiring lock "cinder-93a07cbd-f05f-4c52-94d9-e6e63c02b796-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Lock "cinder-93a07cbd-f05f-4c52-94d9-e6e63c02b796-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Acquiring lock "cinder-quobyte-93a07cbd-f05f-4c52-94d9-e6e63c02b796" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Lock "cinder-quobyte-93a07cbd-f05f-4c52-94d9-e6e63c02b796" acquired by "delete_volume" :: waited 0.041s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1d4c1e-6b33-400e-bb2d-4e58625478c3]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:22 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.377s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Deleted volume successfully. Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f61ae2dc-77f1-4137-9aa8-b248531996c6 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-5c523536-9d1e-451b-9d30-5783c443748c-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:22 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 Jul 18 06:16:22 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:22 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af07eafd-0eca-40c7-8fed-a09304719f19 1073741824" returned: 0 in 0.551s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af07eafd-0eca-40c7-8fed-a09304719f19 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:22 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af07eafd-0eca-40c7-8fed-a09304719f19 Jul 18 06:16:22 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:22 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796" returned: 0 in 0.413s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-a763afc5-3e69-4ac1-809d-e44ee25fa850-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:22 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796 Jul 18 06:16:22 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-a763afc5-3e69-4ac1-809d-e44ee25fa850-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-quobyte-a763afc5-3e69-4ac1-809d-e44ee25fa850" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-a763afc5-3e69-4ac1-809d-e44ee25fa850" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ace6750-bfae-4e90-b06b-0aa76bfd4f18]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a763afc5-3e69-4ac1-809d-e44ee25fa850 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:23 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af07eafd-0eca-40c7-8fed-a09304719f19" returned: 0 in 0.319s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.649s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-598181318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf952a4-afb0-470d-b62b-a14c1041e3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864bdaa793cf40a68a672bd83a75f460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:21Z,use_quota=True,user_id='509637e6dde845319dbeb27fde5e6106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Creating volume ddf952a4-afb0-470d-b62b-a14c1041e3b8 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:23 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:23 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8 1073741824 Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d12290b-17bd-429f-a18d-aa82af9224c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af07eafd-0eca-40c7-8fed-a09304719f19', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:23 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a763afc5-3e69-4ac1-809d-e44ee25fa850 Jul 18 06:16:23 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:23 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:23 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982cccaf-27f5-4156-b603-4adcc44d283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-93a07cbd-f05f-4c52-94d9-e6e63c02b796" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:23 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume volume-af07eafd-0eca-40c7-8fed-a09304719f19 (af07eafd-0eca-40c7-8fed-a09304719f19): created successfully Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982cccaf-27f5-4156-b603-4adcc44d283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Flow 'volume_create_manager' (a7677e94-5099-4bdd-ae2f-1eed692a00f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Lock "cinder-quobyte-93a07cbd-f05f-4c52-94d9-e6e63c02b796" released by "delete_volume" :: held 0.793s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ffcf7139-7c27-4f36-bf24-2159df4c39bc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Created volume successfully. Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Created reservations ['1360465a-8bea-4804-b4ae-3d0aeed35ce9', '32a70fab-931f-43bf-b530-c6268d6612b1', '51b9e7fe-7bbe-43e8-8b48-a0b2bfe31ce9', 'd4a2e956-6dd7-4340-b177-798145bb1523'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:23 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:23 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:23 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a763afc5-3e69-4ac1-809d-e44ee25fa850" returned: 0 in 0.524s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a763afc5-3e69-4ac1-809d-e44ee25fa850 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:23 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a763afc5-3e69-4ac1-809d-e44ee25fa850 Jul 18 06:16:23 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:23 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8 1073741824" returned: 0 in 0.606s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:23 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8 Jul 18 06:16:23 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:23 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a763afc5-3e69-4ac1-809d-e44ee25fa850" returned: 0 in 0.371s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:23 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.457s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-a763afc5-3e69-4ac1-809d-e44ee25fa850" released by "delete_volume" :: held 0.958s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:23 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Deleted volume successfully. Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7800ec96-94ed-499f-91c8-9a70b1600bd1 tempest-VolumeImageDependencyTests-1820167632 None] Lock "cinder-93a07cbd-f05f-4c52-94d9-e6e63c02b796-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Created reservations ['b7caf476-c7b1-4682-ac7b-527d642020d4', 'e432394b-648a-44e7-8d3c-738e63669977', '635edfc7-f1df-4d41-b331-6cc59743e7c4', '675bf673-99d2-4c9e-b651-f51bef48f17c'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:24 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:24 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:24 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8" returned: 0 in 0.391s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.450s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-932556643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='864bdaa793cf40a68a672bd83a75f460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:22Z,use_quota=True,user_id='509637e6dde845319dbeb27fde5e6106',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Creating volume 1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:24 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfb27e2-0ba4-4489-861f-a34b0c1152ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6330f743-02ba-4266-9de6-e0ab11cd3bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:24 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72 1073741824 Jul 18 06:16:24 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:24 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8 (ddf952a4-afb0-470d-b62b-a14c1041e3b8): created successfully Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6330f743-02ba-4266-9de6-e0ab11cd3bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Flow 'volume_create_manager' (22f4b4a5-7848-47f6-ae8b-8e2ad317c2fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Flow 'volume_create_manager' (ca7909be-e0d9-4d38-a7a7-0347f83c850e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06b3d16-80e9-47eb-90e9-154d8cb39a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06b3d16-80e9-47eb-90e9-154d8cb39a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef142f6-ad91-47cc-ba81-6d6ad6c16a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459c0d411fae4787895b93526b7241c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:24Z,use_quota=True,user_id='3a8b483c68fd4244afa4bb8206ed9c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603c76d7-b574-4ae8-baae-13d2c989e729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603c76d7-b574-4ae8-baae-13d2c989e729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd41b31-63fd-4bf4-a2fe-b973a88bf2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd41b31-63fd-4bf4-a2fe-b973a88bf2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef142f6-ad91-47cc-ba81-6d6ad6c16a98', 'volume_name': 'volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574684f3-e628-455d-af71-e265362987e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574684f3-e628-455d-af71-e265362987e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d545b3-6663-4ccf-8e05-12915693e490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:24 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Volume fef142f6-ad91-47cc-ba81-6d6ad6c16a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98', 'volume_size': 1} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1c7c233d-b6af-48cd-9a6c-ebaf42030622 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Created volume successfully. Jul 18 06:16:24 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.344s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Deleted volume successfully. Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-63f63dc7-7989-477f-a989-d07858a24088 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-a763afc5-3e69-4ac1-809d-e44ee25fa850-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:24 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72 1073741824" returned: 0 in 0.513s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:24 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72 Jul 18 06:16:24 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:25 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef142f6-ad91-47cc-ba81-6d6ad6c16a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459c0d411fae4787895b93526b7241c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:24Z,use_quota=True,user_id='3a8b483c68fd4244afa4bb8206ed9c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Creating volume fef142f6-ad91-47cc-ba81-6d6ad6c16a98 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:25 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f8fcd6-52f4-460a-876a-63988ce253c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:25 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98 1073741824 Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e6a142-7427-4bd1-819b-a5247d55fd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:25 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Volume volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72 (1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72): created successfully Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e6a142-7427-4bd1-819b-a5247d55fd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Flow 'volume_create_manager' (cb9f4dd2-7073-4fbd-bb51-1ae2f184954b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-04aa499c-647b-41c9-ac58-e8d35cd2238f tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Created volume successfully. Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-e37e31dc-3ada-4151-b005-e54296c3cfa6-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-e37e31dc-3ada-4151-b005-e54296c3cfa6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-quobyte-e37e31dc-3ada-4151-b005-e54296c3cfa6" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-e37e31dc-3ada-4151-b005-e54296c3cfa6" acquired by "delete_volume" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ccfcae-a510-4ba2-b75f-6241c3f57696]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e37e31dc-3ada-4151-b005-e54296c3cfa6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:25 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e37e31dc-3ada-4151-b005-e54296c3cfa6 Jul 18 06:16:25 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:25 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98 1073741824" returned: 0 in 0.521s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:25 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98 Jul 18 06:16:25 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:25 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e37e31dc-3ada-4151-b005-e54296c3cfa6" returned: 0 in 0.400s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e37e31dc-3ada-4151-b005-e54296c3cfa6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:25 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e37e31dc-3ada-4151-b005-e54296c3cfa6 Jul 18 06:16:25 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:25 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98" returned: 0 in 0.275s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d545b3-6663-4ccf-8e05-12915693e490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36318054-2cdd-4b3d-ad8d-12857f092773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:25 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Volume volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98 (fef142f6-ad91-47cc-ba81-6d6ad6c16a98): created successfully Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36318054-2cdd-4b3d-ad8d-12857f092773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:25 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Flow 'volume_create_manager' (ca7909be-e0d9-4d38-a7a7-0347f83c850e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-27098d51-a9c4-4582-8d8a-937b2f6d4f90 tempest-CinderUnicodeTest-257469577 None] Created volume successfully. Jul 18 06:16:26 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e37e31dc-3ada-4151-b005-e54296c3cfa6" returned: 0 in 0.271s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-e37e31dc-3ada-4151-b005-e54296c3cfa6" released by "delete_volume" :: held 0.726s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Created reservations ['83758ba9-eb38-49df-ab03-0e7cef061b17', '850f2da2-994b-4361-b505-b7901b554794', '6204ae9f-c32b-4a94-b464-916993559338', 'a1211cf5-2c2b-4521-a32e-7c9424024952'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "cinder-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:26 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:26 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "cinder-quobyte-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-quobyte-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[830194c3-69fc-4e2e-b35c-dc1cdea3fafd]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-47c1c12c-f972-4521-84f0-ed303f1925a1-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-47c1c12c-f972-4521-84f0-ed303f1925a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-quobyte-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-quobyte-47c1c12c-f972-4521-84f0-ed303f1925a1" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:26 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72 Jul 18 06:16:26 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-47c1c12c-f972-4521-84f0-ed303f1925a1" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Deleting offline snapshot 47c1c12c-f972-4521-84f0-ed303f1925a1 of volume ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] snapshot_file for this snap is: volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe880c10-efa7-4d24-aa7d-9a2aae0608b6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:26 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.494s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Deleted volume successfully. Jul 18 06:16:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7a088f37-65ad-46d5-8e24-e5bd31121577 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-e37e31dc-3ada-4151-b005-e54296c3cfa6-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:26 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 Jul 18 06:16:26 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:27 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72" returned: 0 in 0.632s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:27 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72 Jul 18 06:16:27 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:27 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1" returned: 0 in 0.514s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fba51d-6fc3-4d7f-bfaf-86de74f2a1c4]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Flow 'volume_create_manager' (42bedc80-fbe7-4625-bec4-5f55fd43871e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc40bcd2-8cab-470c-b286-92f5dadb5307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc40bcd2-8cab-470c-b286-92f5dadb5307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1137745813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4f94d2-1981-407b-b0b4-b59ca6b60e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459c0d411fae4787895b93526b7241c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:27Z,use_quota=True,user_id='3a8b483c68fd4244afa4bb8206ed9c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab70ec6-e2af-40a4-83b4-cd4f7372f12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab70ec6-e2af-40a4-83b4-cd4f7372f12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f927ef2-27d0-46e7-827e-8842153bcc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f927ef2-27d0-46e7-827e-8842153bcc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f4f94d2-1981-407b-b0b4-b59ca6b60e07', 'volume_name': 'volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d6d889-4838-4f9b-8b0a-56d8941d00d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d6d889-4838-4f9b-8b0a-56d8941d00d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d300d9b-fa94-4755-9e2b-c1eb21dc1ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:27 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Volume 7f4f94d2-1981-407b-b0b4-b59ca6b60e07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07', 'volume_size': 1} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1137745813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f4f94d2-1981-407b-b0b4-b59ca6b60e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459c0d411fae4787895b93526b7241c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:27Z,use_quota=True,user_id='3a8b483c68fd4244afa4bb8206ed9c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Creating volume 7f4f94d2-1981-407b-b0b4-b59ca6b60e07 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:27 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:27 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:27 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c Jul 18 06:16:27 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72" returned: 0 in 0.366s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:27 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 1073741824 Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-quobyte-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72" released by "delete_volume" :: held 1.083s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:27 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Created reservations ['54d39173-134a-49e9-8296-618d65dd5c44', '5bd1e508-6f89-469b-9b73-1501ae47a91f', 'fa91663b-3111-4c38-aa6d-a73f6bf1b6fd', '821e5350-e738-4b6a-9084-adbd8400ab35'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:27 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:27 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:27 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c" returned: 0 in 0.464s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:27 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 Jul 18 06:16:27 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:27 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.293s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:27 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Deleted volume successfully. Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ebde2c7d-dff0-4e81-b23c-c2351d058fcc tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-1dfd0c2f-a78c-4cdd-8dc0-065f5c087f72-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:27 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 1073741824" returned: 0 in 0.598s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:28 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 Jul 18 06:16:28 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:28 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1" returned: 0 in 0.420s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:28 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1 Jul 18 06:16:28 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:28 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07" returned: 0 in 0.291s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d300d9b-fa94-4755-9e2b-c1eb21dc1ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06e028c-9aba-4da7-a5f6-7ecfcf94acb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:28 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Volume volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 (7f4f94d2-1981-407b-b0b4-b59ca6b60e07): created successfully Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06e028c-9aba-4da7-a5f6-7ecfcf94acb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Flow 'volume_create_manager' (42bedc80-fbe7-4625-bec4-5f55fd43871e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d8eb38f3-9456-4221-9b17-a3fc0087c837 tempest-CinderUnicodeTest-257469577 None] Created volume successfully. Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:28 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (b44c161c-2f29-4199-b905-82bc87894596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd86482-b835-4b70-b30b-6c5d73d20486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c.47c1c12c-f972-4521-84f0-ed303f1925a1" returned: 0 in 0.355s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd86482-b835-4b70-b30b-6c5d73d20486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645737510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e36fb10-9628-478d-b365-d9ff7144179b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:28Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acda023b-626c-4453-9278-aa351427a36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acda023b-626c-4453-9278-aa351427a36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd15d4a-ea35-4adf-8dfb-a38fbb2494c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd15d4a-ea35-4adf-8dfb-a38fbb2494c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e36fb10-9628-478d-b365-d9ff7144179b', 'volume_name': 'volume-9e36fb10-9628-478d-b365-d9ff7144179b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d177eeb-85e2-456a-a43b-7d7d3d9fd8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d177eeb-85e2-456a-a43b-7d7d3d9fd8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91876795-9f88-4351-afcd-2565acf95e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:28 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Volume 9e36fb10-9628-478d-b365-d9ff7144179b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e36fb10-9628-478d-b365-d9ff7144179b', 'volume_size': 1} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645737510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e36fb10-9628-478d-b365-d9ff7144179b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:28Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Creating volume 9e36fb10-9628-478d-b365-d9ff7144179b {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:28 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:28 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b 1073741824 Jul 18 06:16:28 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "cinder-ddf952a4-afb0-470d-b62b-a14c1041e3b8-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-47c1c12c-f972-4521-84f0-ed303f1925a1" released by "_delete_snapshot" :: held 1.979s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-ddf952a4-afb0-470d-b62b-a14c1041e3b8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c" released by "delete_snapshot" :: held 2.027s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "cinder-quobyte-ddf952a4-afb0-470d-b62b-a14c1041e3b8" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-quobyte-ddf952a4-afb0-470d-b62b-a14c1041e3b8" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[364c6aaa-8777-49f4-a399-47186aba25e3]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Created reservations ['92dddda1-84b5-4339-8f4b-b85a757a29e7', '732bc91c-9c6b-4bcc-806d-ecead7ef1859', '1e852400-f010-46be-ad7c-06ec62565344', '1cfed9bf-d02c-4f9c-8f95-8152b6a1de10'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Delete snapshot completed successfully. Jul 18 06:16:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3e4bf6af-1f8d-4a7b-b75d-0d24d56e6a57 tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-47c1c12c-f972-4521-84f0-ed303f1925a1-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:28 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8 Jul 18 06:16:28 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:29 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b 1073741824" returned: 0 in 0.458s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:29 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b Jul 18 06:16:29 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:29 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8" returned: 0 in 0.392s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:29 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8 Jul 18 06:16:29 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:29 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91876795-9f88-4351-afcd-2565acf95e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e36fb10-9628-478d-b365-d9ff7144179b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500ac997-322b-4dfe-8b6d-71d49b990006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:29 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Volume volume-9e36fb10-9628-478d-b365-d9ff7144179b (9e36fb10-9628-478d-b365-d9ff7144179b): created successfully Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500ac997-322b-4dfe-8b6d-71d49b990006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (b44c161c-2f29-4199-b905-82bc87894596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:29 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddf952a4-afb0-470d-b62b-a14c1041e3b8" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-quobyte-ddf952a4-afb0-470d-b62b-a14c1041e3b8" released by "delete_volume" :: held 0.703s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-1c03811e-c29a-4619-ac84-4b7a0d45bad9 tempest-ProjectMemberTests-636800526 None] Created volume successfully. Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Created reservations ['a3949e35-f9a0-4164-9abf-1bfc30c324d2', 'a0b4622f-0d43-4bea-8078-f87105263400', 'd016ec7b-f3f2-4043-9a96-b61e71227fb5', 'df7a350f-1946-4fbc-942a-5a00906aac01'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:29 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:29 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] Creating offline snapshot f6ad1051-5ead-43b4-aca4-02c26ec561e4 of volume 7f4f94d2-1981-407b-b0b4-b59ca6b60e07 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9a0e54-f373-4145-ae6e-342e1dd54e95]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "cinder-af07eafd-0eca-40c7-8fed-a09304719f19-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-af07eafd-0eca-40c7-8fed-a09304719f19-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:29 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 Jul 18 06:16:29 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:29 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.325s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Deleted volume successfully. Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "cinder-quobyte-af07eafd-0eca-40c7-8fed-a09304719f19" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a84b4971-59b5-4a7f-8626-2f7eecda9cc1 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-ddf952a4-afb0-470d-b62b-a14c1041e3b8-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-quobyte-af07eafd-0eca-40c7-8fed-a09304719f19" acquired by "delete_volume" :: waited 0.040s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2450388f-d833-4cd4-8827-dd85f186f8c6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af07eafd-0eca-40c7-8fed-a09304719f19 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "cinder-quobyte-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b9c8ce-4f10-4692-a62a-984310bed88b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:30 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af07eafd-0eca-40c7-8fed-a09304719f19 Jul 18 06:16:30 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:30 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07" returned: 0 in 0.441s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:30 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 1G Jul 18 06:16:30 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:30 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c Jul 18 06:16:30 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:30 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af07eafd-0eca-40c7-8fed-a09304719f19" returned: 0 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af07eafd-0eca-40c7-8fed-a09304719f19 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:30 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af07eafd-0eca-40c7-8fed-a09304719f19 Jul 18 06:16:30 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:30 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c" returned: 0 in 0.379s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:30 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c Jul 18 06:16:30 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:30 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 1G" returned: 0 in 0.459s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:30 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 Jul 18 06:16:30 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:30 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-af07eafd-0eca-40c7-8fed-a09304719f19" returned: 0 in 0.298s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-quobyte-af07eafd-0eca-40c7-8fed-a09304719f19" released by "delete_volume" :: held 0.761s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:30 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c" returned: 0 in 0.318s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Created reservations ['f48ca4cf-d3bc-48ec-9a36-300ce454d322', '01b802d6-3d21-45fd-a36c-251f2454a3c5', '16ced16f-d631-4c5d-af4c-4dbb4387d66d', 'bd186b97-62ac-4a21-ac31-ccce14e25597'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-quobyte-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c" released by "delete_volume" :: held 0.786s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:30 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:30 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:30 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4" returned: 0 in 0.376s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:30 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 is being set with open permissions: ugo+rw Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:30 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Created reservations ['ed19e16d-395c-4c37-8e57-927ab9bf67d0', 'e7c7a057-523c-47ee-948a-e9442db726ba', 'cf6ab5d2-1164-4f97-a275-1b2d66c1a0e7', '5d23dbfa-437f-40ee-bb89-c02da3ed656d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:30 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:30 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "cinder-bb4cc851-bfff-4435-8711-317768042616-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-bb4cc851-bfff-4435-8711-317768042616-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "cinder-quobyte-bb4cc851-bfff-4435-8711-317768042616" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:31 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:31 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-quobyte-bb4cc851-bfff-4435-8711-317768042616" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e6a8b5-87b7-4610-939c-47e02b172ee4]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bb4cc851-bfff-4435-8711-317768042616 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:31 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.326s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Deleted volume successfully. Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-23f29315-1cd1-487a-b3b8-468b417894ff tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-af07eafd-0eca-40c7-8fed-a09304719f19-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:31 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4" returned: 0 in 0.324s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:31 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bb4cc851-bfff-4435-8711-317768042616 Jul 18 06:16:31 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:31 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.info Jul 18 06:16:31 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:31 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.271s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Deleted volume successfully. Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-de88a7b0-aecd-4116-b40d-bcd14383cdcc tempest-CreateVolumesFromSnapshotTest-277013809 None] Lock "cinder-ddbc2ec6-a7de-4c37-bcbe-f16b0e4ce10c-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:31 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.info" returned: 0 in 0.256s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:31 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.info is being set with open permissions: ugo+rw Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:31 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bb4cc851-bfff-4435-8711-317768042616" returned: 0 in 0.394s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bb4cc851-bfff-4435-8711-317768042616 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:31 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.info Jul 18 06:16:31 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:31 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bb4cc851-bfff-4435-8711-317768042616 Jul 18 06:16:31 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:31 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.info" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.235s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.830s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:31 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-bb4cc851-bfff-4435-8711-317768042616" returned: 0 in 0.295s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] Creating offline snapshot f7d2eb15-b241-4b78-bb20-c01d469e575a of volume 9e36fb10-9628-478d-b365-d9ff7144179b {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-quobyte-bb4cc851-bfff-4435-8711-317768042616" released by "delete_volume" :: held 0.753s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0501a0cd-a421-43dc-8581-26e8405e43b8]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-537e28f0-05d6-4592-9e6c-6bd143a771e0 tempest-CinderUnicodeTest-257469577 None] Create snapshot completed successfully Jul 18 06:16:31 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Created reservations ['43361300-b4b9-435f-bee2-eeca55955973', '1d5d440e-d89c-4214-9c52-cdbd9986a0a7', 'bd5f7061-08d6-49df-8568-08416177b046', '2a80291c-95ce-43a6-9d57-2757508900ba'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:31 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b Jul 18 06:16:31 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:32 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:32 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "cinder-cf836c38-02c7-4ee0-a9b1-89ad282282ef-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-cf836c38-02c7-4ee0-a9b1-89ad282282ef-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "cinder-quobyte-cf836c38-02c7-4ee0-a9b1-89ad282282ef" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:32 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b" returned: 0 in 0.434s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-quobyte-cf836c38-02c7-4ee0-a9b1-89ad282282ef" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:32 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a 1G Jul 18 06:16:32 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:32 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.359s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8026a15e-e672-47ea-8d03-bbc2261b1e2b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:32 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Deleted volume successfully. Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-21863958-503c-4f50-99b1-133f315dd5fe tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-bb4cc851-bfff-4435-8711-317768042616-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:32 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef Jul 18 06:16:32 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Acquiring lock "cinder-f6ad1051-5ead-43b4-aca4-02c26ec561e4-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:32 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Lock "cinder-f6ad1051-5ead-43b4-aca4-02c26ec561e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Acquiring lock "cinder-quobyte-7f4f94d2-1981-407b-b0b4-b59ca6b60e07" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef" returned: 0 in 0.440s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:32 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a 1G" returned: 0 in 0.524s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e36fb10-9628-478d-b365-d9ff7144179b -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Lock "cinder-quobyte-7f4f94d2-1981-407b-b0b4-b59ca6b60e07" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Acquiring lock "cinder-quobyte-f6ad1051-5ead-43b4-aca4-02c26ec561e4" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:32 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef Jul 18 06:16:32 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:32 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e36fb10-9628-478d-b365-d9ff7144179b -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a Jul 18 06:16:32 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Lock "cinder-quobyte-f6ad1051-5ead-43b4-aca4-02c26ec561e4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Deleting offline snapshot f6ad1051-5ead-43b4-aca4-02c26ec561e4 of volume 7f4f94d2-1981-407b-b0b4-b59ca6b60e07 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] snapshot_file for this snap is: volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4724553-8405-443d-8732-3e645ec4456a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:33 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 Jul 18 06:16:33 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-cf836c38-02c7-4ee0-a9b1-89ad282282ef" returned: 0 in 0.367s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:33 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:33 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e36fb10-9628-478d-b365-d9ff7144179b -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a" returned: 0 in 0.357s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:33 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a is being set with open permissions: ugo+rw Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-quobyte-cf836c38-02c7-4ee0-a9b1-89ad282282ef" released by "delete_volume" :: held 0.881s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:33 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a Jul 18 06:16:33 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Created reservations ['fc457077-46b9-4353-94f3-69a616717160', '3aab9111-fa28-4519-be2b-4336e4a54173', '82735f2d-8b11-4e49-9b87-033689224267', 'c67c4962-f6a8-4977-a1aa-36d118beb9c0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:33 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4" returned: 0 in 0.472s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:16:33 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:33 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dea7fa0-e901-4bf3-9025-41b33b80f6d3]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:33 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a" returned: 0 in 0.318s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:33 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.info Jul 18 06:16:33 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:33 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 Jul 18 06:16:33 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:33 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.327s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:33 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Deleted volume successfully. Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f819a75c-22e2-48ae-afbf-93894a6bd3f3 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-cf836c38-02c7-4ee0-a9b1-89ad282282ef-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:33 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.info" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:33 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.info is being set with open permissions: ugo+rw Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:33 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.info Jul 18 06:16:33 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:33 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07" returned: 0 in 0.452s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:33 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 Jul 18 06:16:33 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:34 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.info" returned: 0 in 0.280s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-013d7ae3-70b0-4088-9587-a6119948eb07 tempest-ProjectMemberTests-636800526 None] Create snapshot completed successfully Jul 18 06:16:34 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4" returned: 0 in 0.366s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:34 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4 Jul 18 06:16:34 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "cinder-7287935b-f64a-4840-8eb1-dafeaaaa9122-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-7287935b-f64a-4840-8eb1-dafeaaaa9122-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "cinder-quobyte-7287935b-f64a-4840-8eb1-dafeaaaa9122" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-quobyte-7287935b-f64a-4840-8eb1-dafeaaaa9122" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:34 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07.f6ad1051-5ead-43b4-aca4-02c26ec561e4" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6a123d-680e-4ba0-9046-a2c52b240458]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7287935b-f64a-4840-8eb1-dafeaaaa9122 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Lock "cinder-quobyte-f6ad1051-5ead-43b4-aca4-02c26ec561e4" released by "_delete_snapshot" :: held 1.784s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Lock "cinder-quobyte-7f4f94d2-1981-407b-b0b4-b59ca6b60e07" released by "delete_snapshot" :: held 1.824s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Created reservations ['4b1e8276-737a-4189-9798-78e903352764', 'b94a3e4f-60dd-47d5-bcd9-43b15dcbdb77', '0badd52d-a43e-49fb-9603-b5a17c88409f', 'cbf6c59e-f6ec-4768-b6f1-6afe633dd7dc'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:34 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7287935b-f64a-4840-8eb1-dafeaaaa9122 Jul 18 06:16:34 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Delete snapshot completed successfully. Jul 18 06:16:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-18e3f503-248a-4ab5-bce8-81dcd60329cf tempest-CinderUnicodeTest-257469577 None] Lock "cinder-f6ad1051-5ead-43b4-aca4-02c26ec561e4-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Acquiring lock "cinder-7f4f94d2-1981-407b-b0b4-b59ca6b60e07-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Lock "cinder-7f4f94d2-1981-407b-b0b4-b59ca6b60e07-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Acquiring lock "cinder-quobyte-7f4f94d2-1981-407b-b0b4-b59ca6b60e07" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Lock "cinder-quobyte-7f4f94d2-1981-407b-b0b4-b59ca6b60e07" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:35 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-f7d2eb15-b241-4b78-bb20-c01d469e575a-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7287935b-f64a-4840-8eb1-dafeaaaa9122" returned: 0 in 0.506s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7287935b-f64a-4840-8eb1-dafeaaaa9122 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dddf953-e580-45b6-974c-6309c8adacbc]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:35 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7287935b-f64a-4840-8eb1-dafeaaaa9122 Jul 18 06:16:35 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Lock "cinder-f7d2eb15-b241-4b78-bb20-c01d469e575a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-9e36fb10-9628-478d-b365-d9ff7144179b" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:35 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:35 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-9e36fb10-9628-478d-b365-d9ff7144179b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-f7d2eb15-b241-4b78-bb20-c01d469e575a" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-f7d2eb15-b241-4b78-bb20-c01d469e575a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Deleting offline snapshot f7d2eb15-b241-4b78-bb20-c01d469e575a of volume 9e36fb10-9628-478d-b365-d9ff7144179b {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:16:35 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 Jul 18 06:16:35 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] snapshot_file for this snap is: volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8595b71c-2f4a-4b66-9a4f-6e7652a5d008]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:35 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a Jul 18 06:16:35 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:35 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7287935b-f64a-4840-8eb1-dafeaaaa9122" returned: 0 in 0.448s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-quobyte-7287935b-f64a-4840-8eb1-dafeaaaa9122" released by "delete_volume" :: held 1.058s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:35 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07" returned: 0 in 0.476s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:35 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.479s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:16:35 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07 Jul 18 06:16:35 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Created reservations ['193b0524-84f1-4c8a-9d07-93e2f6bf8b10', 'b6da1764-95d0-420f-8fc9-063e48023ba3', 'a9a81266-ae3a-43cb-b9c9-1e557151b142', 'c2002ada-b4f2-49e4-ba5e-0d619d813cb5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:35 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:35 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a" returned: 0 in 0.518s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e36fb10-9628-478d-b365-d9ff7144179b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:16:35 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc92ef0-5133-4c48-83ca-a5a7731d103c]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:35 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7f4f94d2-1981-407b-b0b4-b59ca6b60e07" returned: 0 in 0.319s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Lock "cinder-quobyte-7f4f94d2-1981-407b-b0b4-b59ca6b60e07" released by "delete_volume" :: held 0.901s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:36 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b Jul 18 06:16:36 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Created reservations ['efdb931c-064b-469b-9e5a-1d56979d8847', '088a5e3a-96c1-4b1d-911b-106a02b4b6a4', '92c1b5a3-fd84-4089-a395-914a792ca190', 'ea08133d-62ab-4cd6-b816-f35e3df484aa'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4ff27ad4-a35c-4e3c-923d-78c797d2e7c6 tempest-ProjectAdminTests-1462344213 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7434043884277, 'free_capacity_gb': 1775.7434043884277, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87750) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 18 06:16:36 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.305s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Deleted volume successfully. Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-a4e33548-2e5b-4115-af81-b183febeaa52 tempest-CreateVolumesFromSourceVolumeTest-280620181 None] Lock "cinder-7287935b-f64a-4840-8eb1-dafeaaaa9122-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:36 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:36 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Acquiring lock "cinder-fef142f6-ad91-47cc-ba81-6d6ad6c16a98-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Lock "cinder-fef142f6-ad91-47cc-ba81-6d6ad6c16a98-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Acquiring lock "cinder-quobyte-fef142f6-ad91-47cc-ba81-6d6ad6c16a98" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:36 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b" returned: 0 in 0.489s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Lock "cinder-quobyte-fef142f6-ad91-47cc-ba81-6d6ad6c16a98" acquired by "delete_volume" :: waited 0.045s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:36 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a Jul 18 06:16:36 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f70c4d5-de24-4b8d-917c-9ce6268de412]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:36 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.348s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Deleted volume successfully. Jul 18 06:16:36 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98 Jul 18 06:16:36 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0ecb8501-72df-4f5d-80e5-7c407fa8e3d5 tempest-CinderUnicodeTest-257469577 None] Lock "cinder-7f4f94d2-1981-407b-b0b4-b59ca6b60e07-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:36 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a" returned: 0 in 0.426s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:36 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98" returned: 0 in 0.400s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:36 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a Jul 18 06:16:36 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:36 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98 Jul 18 06:16:36 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:37 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b.f7d2eb15-b241-4b78-bb20-c01d469e575a" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-f7d2eb15-b241-4b78-bb20-c01d469e575a" released by "_delete_snapshot" :: held 1.847s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-9e36fb10-9628-478d-b365-d9ff7144179b" released by "delete_snapshot" :: held 1.886s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:37 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-fef142f6-ad91-47cc-ba81-6d6ad6c16a98" returned: 0 in 0.322s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Lock "cinder-quobyte-fef142f6-ad91-47cc-ba81-6d6ad6c16a98" released by "delete_volume" :: held 0.782s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Created reservations ['a5d70a84-cc7c-4565-bffe-904c22082e2a', 'e6fa4857-61ed-4051-8e2e-803264b8d6e7', 'ab15c2f1-fb68-443b-b6b8-2381c4d53623', 'c12e70e1-651c-4aca-924c-331711a3f98d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Created reservations ['51626c5d-0334-41f9-944d-45def1d9d65a', '010a5e05-2ff7-4f3d-b0e5-59f1f6959143', '9432d6ec-a83d-4fb5-a68b-57ebec8cb9fe', 'b8fee650-78ef-4fb1-aed5-84b421b304d7'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Delete snapshot completed successfully. Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7ed8b0e6-d21e-4b5c-a3d4-6f798b4c4602 tempest-ProjectMemberTests-636800526 None] Lock "cinder-f7d2eb15-b241-4b78-bb20-c01d469e575a-delete_snapshot" released by "delete_snapshot" :: held 2.140s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:37 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:37 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:37 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.383s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:37 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Deleted volume successfully. Jul 18 06:16:37 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-223a6e61-52d0-48b5-bb26-2a2fed7574f8 tempest-CinderUnicodeTest-257469577 None] Lock "cinder-fef142f6-ad91-47cc-ba81-6d6ad6c16a98-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-9e36fb10-9628-478d-b365-d9ff7144179b-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Lock "cinder-9e36fb10-9628-478d-b365-d9ff7144179b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-9e36fb10-9628-478d-b365-d9ff7144179b" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:38 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-9e36fb10-9628-478d-b365-d9ff7144179b" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:38 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4177694e-0801-435d-a1e4-f359bbc661fd]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:38 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b Jul 18 06:16:38 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:39 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b" returned: 0 in 0.507s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:39 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b Jul 18 06:16:39 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:39 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-9e36fb10-9628-478d-b365-d9ff7144179b" returned: 0 in 0.277s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-9e36fb10-9628-478d-b365-d9ff7144179b" released by "delete_volume" :: held 0.859s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Created reservations ['c3c174f7-de23-4fa6-ae6f-bc8f45899ea3', 'fe5903e8-fbdc-4d56-83a7-911764e787b4', 'f5277da2-2fe1-40dd-9085-bd379f586bae', '90900f7e-95e6-42c6-b4b0-f61335444dac'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:39 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:39 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:39 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Deleted volume successfully. Jul 18 06:16:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0e829ace-ac50-446f-b5be-0aead9f97d2d tempest-ProjectMemberTests-636800526 None] Lock "cinder-9e36fb10-9628-478d-b365-d9ff7144179b-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (d988acbc-f090-426c-813e-d523a200b2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c27ec3-f482-4ead-a1b4-a7573d0b8c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c27ec3-f482-4ead-a1b4-a7573d0b8c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98249603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7a8763-64f1-4121-9544-735e47aabbf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:40Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d133a4ab-5f5a-4222-98ea-be1f7b2d1026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d133a4ab-5f5a-4222-98ea-be1f7b2d1026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926a6895-449a-459d-a024-a220eb239560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926a6895-449a-459d-a024-a220eb239560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c7a8763-64f1-4121-9544-735e47aabbf0', 'volume_name': 'volume-4c7a8763-64f1-4121-9544-735e47aabbf0', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538bb4f2-50b9-4e21-8401-2832369fef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538bb4f2-50b9-4e21-8401-2832369fef70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58083a13-22cd-4834-a478-86b21c02452b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:40 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Volume 4c7a8763-64f1-4121-9544-735e47aabbf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c7a8763-64f1-4121-9544-735e47aabbf0', 'volume_size': 1} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-98249603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7a8763-64f1-4121-9544-735e47aabbf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:40Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Creating volume 4c7a8763-64f1-4121-9544-735e47aabbf0 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:40 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:40 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 1073741824 Jul 18 06:16:40 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:40 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 1073741824" returned: 0 in 0.508s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:40 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 Jul 18 06:16:40 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:41 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0" returned: 0 in 0.285s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:41 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58083a13-22cd-4834-a478-86b21c02452b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c7a8763-64f1-4121-9544-735e47aabbf0', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee11e44-28ec-413d-bdc3-32a9fd3f57f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:41 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Volume volume-4c7a8763-64f1-4121-9544-735e47aabbf0 (4c7a8763-64f1-4121-9544-735e47aabbf0): created successfully Jul 18 06:16:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee11e44-28ec-413d-bdc3-32a9fd3f57f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:41 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (d988acbc-f090-426c-813e-d523a200b2df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7e5c2818-a6e5-42df-b178-edfe17c83f22 tempest-ProjectMemberTests-636800526 None] Created volume successfully. Jul 18 06:16:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] Creating offline snapshot d44cdb90-35b7-40db-859b-c86763ef49c6 of volume 4c7a8763-64f1-4121-9544-735e47aabbf0 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:16:42 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a7c3a5-ac59-4ebb-bda7-bb14a74f85a9]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:42 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 Jul 18 06:16:42 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:42 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0" returned: 0 in 0.494s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:43 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 1G Jul 18 06:16:43 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:43 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 1G" returned: 0 in 0.501s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c7a8763-64f1-4121-9544-735e47aabbf0 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:43 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c7a8763-64f1-4121-9544-735e47aabbf0 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 Jul 18 06:16:43 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:43 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c7a8763-64f1-4121-9544-735e47aabbf0 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:43 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 is being set with open permissions: ugo+rw Jul 18 06:16:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:43 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 Jul 18 06:16:43 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:44 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6" returned: 0 in 0.340s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:44 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.info Jul 18 06:16:44 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:44 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.info" returned: 0 in 0.307s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:44 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.info is being set with open permissions: ugo+rw Jul 18 06:16:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:44 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.info Jul 18 06:16:44 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:44 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.info" returned: 0 in 0.331s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.452s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-91216064-29d3-4b7e-becf-f2fe46a1c4cf tempest-ProjectMemberTests-636800526 None] Create snapshot completed successfully Jul 18 06:16:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-d44cdb90-35b7-40db-859b-c86763ef49c6-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Lock "cinder-d44cdb90-35b7-40db-859b-c86763ef49c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-4c7a8763-64f1-4121-9544-735e47aabbf0" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-4c7a8763-64f1-4121-9544-735e47aabbf0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-d44cdb90-35b7-40db-859b-c86763ef49c6" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:45 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-d44cdb90-35b7-40db-859b-c86763ef49c6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Deleting offline snapshot d44cdb90-35b7-40db-859b-c86763ef49c6 of volume 4c7a8763-64f1-4121-9544-735e47aabbf0 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:16:45 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] snapshot_file for this snap is: volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:16:45 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46c36d8-7ecd-46b7-84c1-78a8f5fdd718]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:45 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:46 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 Jul 18 06:16:46 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:46 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6" returned: 0 in 0.492s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c7a8763-64f1-4121-9544-735e47aabbf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:16:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9790a806-b705-499a-8038-73502cfb252c]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:46 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 Jul 18 06:16:46 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:46 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0" returned: 0 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:46 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 Jul 18 06:16:46 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:47 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6" returned: 0 in 0.368s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:47 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6 Jul 18 06:16:47 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:47 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0.d44cdb90-35b7-40db-859b-c86763ef49c6" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-d44cdb90-35b7-40db-859b-c86763ef49c6" released by "_delete_snapshot" :: held 1.720s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-4c7a8763-64f1-4121-9544-735e47aabbf0" released by "delete_snapshot" :: held 1.752s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:47 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Created reservations ['3bfdf41d-b051-494a-8ae5-274d8c75b8ae', '082e4e4a-a95a-4bb6-a5bd-8c9569854a34', '0aa6114c-ffed-4409-b859-2b4792decafa', 'ec2ea0b3-222c-4b18-a295-0e6301514e21'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:47 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Delete snapshot completed successfully. Jul 18 06:16:47 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4b4567be-918a-4938-a6ba-6334d026a056 tempest-ProjectMemberTests-636800526 None] Lock "cinder-d44cdb90-35b7-40db-859b-c86763ef49c6-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:47 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Flow 'volume_create_manager' (cb7287f4-9235-46f5-9b11-cb3c953d7bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:47 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ef3765-f47a-42c3-9454-ede1f2738d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Flow 'volume_create_manager' (fd178e6b-de61-455a-a269-4d484fa4ee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7beade-457a-4ba2-af73-8754bffb51d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-4c7a8763-64f1-4121-9544-735e47aabbf0-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ef3765-f47a-42c3-9454-ede1f2738d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048312195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae19b685-20cb-4e6b-b844-929ec5f92bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1674783fd65941bd823a6009ecf58eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:48Z,use_quota=True,user_id='140d1ee20a8c461b80512320ef4b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3a1e15-676e-4311-9156-28d1fefc5ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3a1e15-676e-4311-9156-28d1fefc5ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7eea61-d3c4-44b6-b332-183c24b4fef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7eea61-d3c4-44b6-b332-183c24b4fef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae19b685-20cb-4e6b-b844-929ec5f92bd1', 'volume_name': 'volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32a6b15-edff-4465-9a18-a01334d21e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32a6b15-edff-4465-9a18-a01334d21e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89dd6d3b-4a0b-426d-b292-a317d65b5487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:48 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Volume ae19b685-20cb-4e6b-b844-929ec5f92bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1', 'volume_size': 1} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2048312195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae19b685-20cb-4e6b-b844-929ec5f92bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1674783fd65941bd823a6009ecf58eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:48Z,use_quota=True,user_id='140d1ee20a8c461b80512320ef4b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Creating volume ae19b685-20cb-4e6b-b844-929ec5f92bd1 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:48 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7beade-457a-4ba2-af73-8754bffb51d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-735390961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a451e01-50cd-42ee-811c-700601d1f67b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bba4e85901646c1bd56ab079c1b7c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:48Z,use_quota=True,user_id='c71339aa2027448ba68c4c18d0ab0945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:48 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 1073741824 Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3c6dce-0f1c-4d4a-807b-72253d20202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:48 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3c6dce-0f1c-4d4a-807b-72253d20202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6795a5cc-c51d-4a2a-a6b4-fe4eb2e478e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6795a5cc-c51d-4a2a-a6b4-fe4eb2e478e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a451e01-50cd-42ee-811c-700601d1f67b', 'volume_name': 'volume-4a451e01-50cd-42ee-811c-700601d1f67b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6cc3b0-a44d-4042-9713-1b6d156dac30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6cc3b0-a44d-4042-9713-1b6d156dac30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26e4e64-a0b8-4516-a1c3-3ae205c37aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:48 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Volume 4a451e01-50cd-42ee-811c-700601d1f67b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a451e01-50cd-42ee-811c-700601d1f67b', 'volume_size': 1} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Lock "cinder-4c7a8763-64f1-4121-9544-735e47aabbf0-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-4c7a8763-64f1-4121-9544-735e47aabbf0" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-4c7a8763-64f1-4121-9544-735e47aabbf0" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0434af-d6de-4ef9-b108-1f2ae4d14b66]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:48 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 Jul 18 06:16:48 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:48 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 1073741824" returned: 0 in 0.509s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:48 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0" returned: 0 in 0.434s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:48 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 Jul 18 06:16:48 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:48 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0 Jul 18 06:16:48 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:48 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1" returned: 0 in 0.293s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-735390961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a451e01-50cd-42ee-811c-700601d1f67b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bba4e85901646c1bd56ab079c1b7c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:48Z,use_quota=True,user_id='c71339aa2027448ba68c4c18d0ab0945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Creating volume 4a451e01-50cd-42ee-811c-700601d1f67b {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:48 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4a451e01-50cd-42ee-811c-700601d1f67b 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:48 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4c7a8763-64f1-4121-9544-735e47aabbf0" returned: 0 in 0.304s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:49 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4a451e01-50cd-42ee-811c-700601d1f67b 1073741824 Jul 18 06:16:49 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89dd6d3b-4a0b-426d-b292-a317d65b5487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2523767b-d63f-48a8-bfaf-9840120cbe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-4c7a8763-64f1-4121-9544-735e47aabbf0" released by "delete_volume" :: held 0.817s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Volume volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 (ae19b685-20cb-4e6b-b844-929ec5f92bd1): created successfully Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2523767b-d63f-48a8-bfaf-9840120cbe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Flow 'volume_create_manager' (cb7287f4-9235-46f5-9b11-cb3c953d7bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-73de4db9-470b-4e1e-b6e7-0b6276ad6b50 tempest-ProjectReaderTests-806745192 None] Created volume successfully. Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Created reservations ['e506429a-4669-4a34-ac13-79eb55356c07', '00d90a6f-babb-4be7-9929-66abfa36ef86', 'c6e70dfd-00b6-432e-953b-1133503a135f', '247dbb75-b50d-48d5-8527-5176d825f5d9'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:49 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:49 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:49 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4a451e01-50cd-42ee-811c-700601d1f67b 1073741824" returned: 0 in 0.509s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4a451e01-50cd-42ee-811c-700601d1f67b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:49 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4a451e01-50cd-42ee-811c-700601d1f67b Jul 18 06:16:49 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:49 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.311s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Deleted volume successfully. Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-ac267a5e-6524-42aa-a2af-261338183a1f tempest-ProjectMemberTests-636800526 None] Lock "cinder-4c7a8763-64f1-4121-9544-735e47aabbf0-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:49 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4a451e01-50cd-42ee-811c-700601d1f67b" returned: 0 in 0.276s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26e4e64-a0b8-4516-a1c3-3ae205c37aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a451e01-50cd-42ee-811c-700601d1f67b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0057ff5-cbac-40ef-92ef-5c99b2863023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:49 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Volume volume-4a451e01-50cd-42ee-811c-700601d1f67b (4a451e01-50cd-42ee-811c-700601d1f67b): created successfully Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0057ff5-cbac-40ef-92ef-5c99b2863023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:49 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Flow 'volume_create_manager' (fd178e6b-de61-455a-a269-4d484fa4ee92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:49 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-513d5bce-8ebc-4e92-b24c-6da1f5bd19d0 tempest-ProjectReaderTests-692496783 None] Created volume successfully. Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] Creating offline snapshot 59721e79-c91b-4720-84c6-5b7a181867a8 of volume ae19b685-20cb-4e6b-b844-929ec5f92bd1 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a6b457-cc4f-426c-9ac0-9ee47c1e23b6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:50 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 Jul 18 06:16:50 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:50 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1" returned: 0 in 0.373s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:50 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 1G Jul 18 06:16:50 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=253,cinder:UPDATE=313,cinder:DELETE=32,cinder:INSERT=81 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=221,cinder:UPDATE=326,cinder:INSERT=89,cinder:DELETE=25 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (ff6163b8-2cf3-45c2-becd-8b7f6ec2f718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807d94ec-01fa-4d9b-a6ad-6dd7cfe3ce3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:50 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 1G" returned: 0 in 0.508s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807d94ec-01fa-4d9b-a6ad-6dd7cfe3ce3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1426080699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a85d47-b94c-4924-8799-8fbbdeadd1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:51Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b99b50e-8675-497d-991f-314aadc00f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b99b50e-8675-497d-991f-314aadc00f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad70a07-208d-426b-b828-0c4675d5c89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ad70a07-208d-426b-b828-0c4675d5c89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a85d47-b94c-4924-8799-8fbbdeadd1cf', 'volume_name': 'volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06e18f6-4b5a-4403-93e1-b62ed227b2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06e18f6-4b5a-4403-93e1-b62ed227b2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616955b8-0ccc-4388-a2f1-29b7e9c2d653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:50 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Volume 94a85d47-b94c-4924-8799-8fbbdeadd1cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf', 'volume_size': 1} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:51 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 Jul 18 06:16:51 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Acquiring lock "cinder-4a451e01-50cd-42ee-811c-700601d1f67b-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Lock "cinder-4a451e01-50cd-42ee-811c-700601d1f67b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Acquiring lock "cinder-quobyte-4a451e01-50cd-42ee-811c-700601d1f67b" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Lock "cinder-quobyte-4a451e01-50cd-42ee-811c-700601d1f67b" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:51 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8" returned: 0 in 0.480s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:51 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 is being set with open permissions: ugo+rw Jul 18 06:16:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:51 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc47dfb-13a7-4d12-a0ce-621dbfb3f1e4]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4a451e01-50cd-42ee-811c-700601d1f67b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:51 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 Jul 18 06:16:51 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:51 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4a451e01-50cd-42ee-811c-700601d1f67b Jul 18 06:16:51 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:51 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8" returned: 0 in 0.286s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:51 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.info Jul 18 06:16:51 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:51 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4a451e01-50cd-42ee-811c-700601d1f67b" returned: 0 in 0.428s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4a451e01-50cd-42ee-811c-700601d1f67b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:51 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4a451e01-50cd-42ee-811c-700601d1f67b Jul 18 06:16:51 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:52 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.info" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:52 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.info is being set with open permissions: ugo+rw Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:52 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.info Jul 18 06:16:52 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:52 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4a451e01-50cd-42ee-811c-700601d1f67b" returned: 0 in 0.277s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Lock "cinder-quobyte-4a451e01-50cd-42ee-811c-700601d1f67b" released by "delete_volume" :: held 0.757s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Created reservations ['52c54074-db4f-48d4-b20a-859ad4cb66e7', 'd6051518-5737-452c-be87-f2838d3ff8ef', '7faac877-2969-401c-b973-86020bf78524', '317dec5b-06ea-414f-b1d6-3dbe90a0827f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:52 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.info" returned: 0 in 0.261s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:52 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:52 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.364s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1426080699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a85d47-b94c-4924-8799-8fbbdeadd1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:51Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Creating volume 94a85d47-b94c-4924-8799-8fbbdeadd1cf {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:52 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:52 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf 1073741824 Jul 18 06:16:52 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-74bfde04-b68d-45b9-95f7-770ead304026 tempest-ProjectReaderTests-806745192 None] Create snapshot completed successfully Jul 18 06:16:52 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.272s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Deleted volume successfully. Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-419c093e-eb72-4d05-87ab-c155669ded79 tempest-ProjectReaderTests-692496783 None] Lock "cinder-4a451e01-50cd-42ee-811c-700601d1f67b-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:52 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf 1073741824" returned: 0 in 0.517s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:52 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf Jul 18 06:16:52 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:52 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Flow 'volume_create_manager' (372ad972-4aa8-4e0c-8f7f-b06bdb1c71ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9dfeb67-f0ae-44f6-8b1f-04fa688eb582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9dfeb67-f0ae-44f6-8b1f-04fa688eb582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082383694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bba4e85901646c1bd56ab079c1b7c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:53Z,use_quota=True,user_id='c71339aa2027448ba68c4c18d0ab0945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998bb2ee-7e86-4952-bdbc-09b031692585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998bb2ee-7e86-4952-bdbc-09b031692585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e13d8f-65ec-49a0-8f00-d69a94576751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e13d8f-65ec-49a0-8f00-d69a94576751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db', 'volume_name': 'volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7293f2e-abf3-43fe-be11-15879a399341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7293f2e-abf3-43fe-be11-15879a399341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ab359b-c2d0-4517-b5cd-744c0d74a360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Volume 5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db', 'volume_size': 1} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:53 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf" returned: 0 in 0.262s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.047s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082383694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bba4e85901646c1bd56ab079c1b7c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:53Z,use_quota=True,user_id='c71339aa2027448ba68c4c18d0ab0945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Creating volume 5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:53 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616955b8-0ccc-4388-a2f1-29b7e9c2d653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:53 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db 1073741824 Jul 18 06:16:53 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0072fbe1-e60c-4ab7-8743-90457848e609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:53 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Volume volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf (94a85d47-b94c-4924-8799-8fbbdeadd1cf): created successfully Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0072fbe1-e60c-4ab7-8743-90457848e609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (ff6163b8-2cf3-45c2-becd-8b7f6ec2f718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:53 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-90d19bc7-b543-4037-b7de-425efb9be5e2 tempest-ProjectMemberTests-636800526 None] Created volume successfully. Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-59721e79-c91b-4720-84c6-5b7a181867a8-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Lock "cinder-59721e79-c91b-4720-84c6-5b7a181867a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-ae19b685-20cb-4e6b-b844-929ec5f92bd1" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-ae19b685-20cb-4e6b-b844-929ec5f92bd1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-59721e79-c91b-4720-84c6-5b7a181867a8" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-59721e79-c91b-4720-84c6-5b7a181867a8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Deleting offline snapshot 59721e79-c91b-4720-84c6-5b7a181867a8 of volume ae19b685-20cb-4e6b-b844-929ec5f92bd1 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] snapshot_file for this snap is: volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[59570082-ddae-4295-8902-7f2a5ea6dd8a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:53 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 Jul 18 06:16:53 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:53 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db 1073741824" returned: 0 in 0.517s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:53 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db Jul 18 06:16:53 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:53 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8" returned: 0 in 0.471s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d4e1f8-efae-4b8c-b026-9fbd792ddde7]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:53 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:54 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db" returned: 0 in 0.305s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ab359b-c2d0-4517-b5cd-744c0d74a360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095aef41-0e3d-4397-90dd-7c1349836dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:54 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Volume volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db (5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db): created successfully Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095aef41-0e3d-4397-90dd-7c1349836dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Flow 'volume_create_manager' (372ad972-4aa8-4e0c-8f7f-b06bdb1c71ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:54 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-70118d66-5fc2-4d76-88ba-a84bbe9db1d4 tempest-ProjectReaderTests-692496783 None] Created volume successfully. Jul 18 06:16:54 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 Jul 18 06:16:54 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] Creating offline snapshot 12e47267-2de4-427d-afa5-73d33eafa36d of volume 94a85d47-b94c-4924-8799-8fbbdeadd1cf {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[f336c9ad-ef56-4de2-8c66-04879df1cbfb]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:54 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1" returned: 0 in 0.450s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:54 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 Jul 18 06:16:54 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:54 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf Jul 18 06:16:54 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:54 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8" returned: 0 in 0.348s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:54 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf" returned: 0 in 0.395s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:54 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:54 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8 Jul 18 06:16:54 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:54 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d 1G Jul 18 06:16:54 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:55 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1.59721e79-c91b-4720-84c6-5b7a181867a8" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-59721e79-c91b-4720-84c6-5b7a181867a8" released by "_delete_snapshot" :: held 1.672s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-ae19b685-20cb-4e6b-b844-929ec5f92bd1" released by "delete_snapshot" :: held 1.697s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Acquiring lock "cinder-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Lock "cinder-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Acquiring lock "cinder-quobyte-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Created reservations ['86165f88-91fa-4db9-a931-dd999a549066', 'c30b54e1-5110-4228-b647-0fdeddd7fdf3', '76bd12ce-afea-438d-b878-091657f35093', '6bef5f75-701c-44f5-9ab5-5bdf3f70c4fe'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Lock "cinder-quobyte-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a643595-9c60-4667-b9d3-13e3582fbdc0]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:55 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d 1G" returned: 0 in 0.498s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:55 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Delete snapshot completed successfully. Jul 18 06:16:55 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d Jul 18 06:16:55 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d96d3854-27c5-48cf-b712-6711e405be15 tempest-ProjectReaderTests-806745192 None] Lock "cinder-59721e79-c91b-4720-84c6-5b7a181867a8-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:55 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db Jul 18 06:16:55 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-ae19b685-20cb-4e6b-b844-929ec5f92bd1-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Lock "cinder-ae19b685-20cb-4e6b-b844-929ec5f92bd1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-ae19b685-20cb-4e6b-b844-929ec5f92bd1" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:55 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-ae19b685-20cb-4e6b-b844-929ec5f92bd1" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d" returned: 0 in 0.448s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:55 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d is being set with open permissions: ugo+rw Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d77ef5-8804-4f11-b48e-3f374b52ec51]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:55 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d Jul 18 06:16:55 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:55 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db" returned: 0 in 0.567s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:55 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:55 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db Jul 18 06:16:55 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:55 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 Jul 18 06:16:55 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:56 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d" returned: 0 in 0.287s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:56 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.info Jul 18 06:16:56 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:56 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db" returned: 0 in 0.287s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Lock "cinder-quobyte-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db" released by "delete_volume" :: held 0.898s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Created reservations ['d69a7d46-27be-4408-b8a6-a488f9a811b6', '20a5b603-4de8-4402-af77-f0381e3c8d12', 'af81da60-cff3-4022-924c-1fed38c09dfb', '1ad75dbc-65e6-4161-b9ad-fcee39000dd1'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:56 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1" returned: 0 in 0.467s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:56 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1 Jul 18 06:16:56 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:56 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:56 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:56 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.info" returned: 0 in 0.339s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:56 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.info is being set with open permissions: ugo+rw Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:56 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.info Jul 18 06:16:56 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:56 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ae19b685-20cb-4e6b-b844-929ec5f92bd1" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-ae19b685-20cb-4e6b-b844-929ec5f92bd1" released by "delete_volume" :: held 0.919s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:56 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.400s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Deleted volume successfully. Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Created reservations ['fda645e3-1199-40f0-90c3-0b6137dee745', '1d277b0d-32d2-4a99-ac96-45ad78dcf0d5', '4c133336-9535-4df4-a979-be04d7f1fe7a', 'f36161e9-3e19-4b6f-8171-2cde404e89df'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-d076f873-0aaa-4e99-9783-695051f0ded4 tempest-ProjectReaderTests-692496783 None] Lock "cinder-5935ba96-9cb7-4f3f-b0d9-5dd8c908a7db-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:56 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.info" returned: 0 in 0.447s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:56 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:16:56 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:56 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:56 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-877aed61-503d-45ca-8e73-7060ad20e0b3 tempest-ProjectMemberTests-636800526 None] Create snapshot completed successfully Jul 18 06:16:57 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.297s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:16:57 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Deleted volume successfully. Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-751bdc30-5819-4a53-9b3b-fd81b4f91180 tempest-ProjectReaderTests-806745192 None] Lock "cinder-ae19b685-20cb-4e6b-b844-929ec5f92bd1-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-12e47267-2de4-427d-afa5-73d33eafa36d-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Lock "cinder-12e47267-2de4-427d-afa5-73d33eafa36d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-94a85d47-b94c-4924-8799-8fbbdeadd1cf" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-94a85d47-b94c-4924-8799-8fbbdeadd1cf" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-12e47267-2de4-427d-afa5-73d33eafa36d" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-12e47267-2de4-427d-afa5-73d33eafa36d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Deleting offline snapshot 12e47267-2de4-427d-afa5-73d33eafa36d of volume 94a85d47-b94c-4924-8799-8fbbdeadd1cf {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] snapshot_file for this snap is: volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45d4cea-0c93-4d13-bfb0-e3b7f99ad2ff]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:57 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d Jul 18 06:16:57 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:58 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d" returned: 0 in 0.450s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[af26d510-6022-4aeb-9b52-133a432d3823]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:58 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf Jul 18 06:16:58 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Flow 'volume_create_manager' (9c5fd315-bd45-4e6b-9a39-138757e49ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6c07f8-5b8f-4cd4-82c8-f013c4a5f6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:58 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf" returned: 0 in 0.532s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6c07f8-5b8f-4cd4-82c8-f013c4a5f6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664119851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1674783fd65941bd823a6009ecf58eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:59Z,use_quota=True,user_id='140d1ee20a8c461b80512320ef4b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecf1a30-47b8-4426-be63-5102bc680862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:58 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d Jul 18 06:16:58 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecf1a30-47b8-4426-be63-5102bc680862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8ff4e5-2a4c-4852-949a-abc0857a4ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8ff4e5-2a4c-4852-949a-abc0857a4ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2', 'volume_name': 'volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1d5681-58e6-4767-ad14-063029a781b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1d5681-58e6-4767-ad14-063029a781b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85df4a7-93e1-4796-abac-ff510411d53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Volume 8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2', 'volume_size': 1} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664119851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1674783fd65941bd823a6009ecf58eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:16:59Z,use_quota=True,user_id='140d1ee20a8c461b80512320ef4b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Creating volume 8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:16:58 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:16:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:58 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 1073741824 Jul 18 06:16:58 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:59 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d" returned: 0 in 0.436s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:59 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d Jul 18 06:16:59 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:59 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 1073741824" returned: 0 in 0.539s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:16:59 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 Jul 18 06:16:59 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:16:59 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf.12e47267-2de4-427d-afa5-73d33eafa36d" returned: 0 in 0.290s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-12e47267-2de4-427d-afa5-73d33eafa36d" released by "_delete_snapshot" :: held 1.882s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-94a85d47-b94c-4924-8799-8fbbdeadd1cf" released by "delete_snapshot" :: held 1.914s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Created reservations ['8e19fea0-a49b-47b4-9025-a2729042a020', '826fe39a-22ec-4e73-a476-896a1fd9ba8d', 'e602009e-5612-4946-8e5f-f8aa7f1eab6e', '0a4d85fc-cd71-40f2-82ce-e6181d01dd74'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:16:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Delete snapshot completed successfully. Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4121577e-b1ad-4ed0-9848-ef1e3a53880b tempest-ProjectMemberTests-636800526 None] Lock "cinder-12e47267-2de4-427d-afa5-73d33eafa36d-delete_snapshot" released by "delete_snapshot" :: held 2.110s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:16:59 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2" returned: 0 in 0.374s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-94a85d47-b94c-4924-8799-8fbbdeadd1cf-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85df4a7-93e1-4796-abac-ff510411d53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca25c9a-7907-4e5f-9fb6-01c5958b34d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Lock "cinder-94a85d47-b94c-4924-8799-8fbbdeadd1cf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:59 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Volume volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 (8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2): created successfully Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca25c9a-7907-4e5f-9fb6-01c5958b34d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Flow 'volume_create_manager' (9c5fd315-bd45-4e6b-9a39-138757e49ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:16:59 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-99769171-a9ef-44f0-8d87-10e56b5ab1aa tempest-ProjectReaderTests-806745192 None] Created volume successfully. Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-94a85d47-b94c-4924-8799-8fbbdeadd1cf" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-94a85d47-b94c-4924-8799-8fbbdeadd1cf" acquired by "delete_volume" :: waited 0.023s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6189ac86-235a-4c57-a262-06138e899f1f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:16:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:00 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf Jul 18 06:17:00 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:00 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf" returned: 0 in 0.431s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:00 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf Jul 18 06:17:00 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:00 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-94a85d47-b94c-4924-8799-8fbbdeadd1cf" returned: 0 in 0.308s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:00 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-94a85d47-b94c-4924-8799-8fbbdeadd1cf" released by "delete_volume" :: held 0.819s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:00 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Created reservations ['a32c36d7-d28b-4b38-908d-89344ca46612', 'cc942d34-3c3c-476b-b7ea-cf36966b7614', '86263f08-17a5-47de-b45c-ae63f36c2c7e', 'fd9aa84e-87ba-4bdc-be48-635364f5532f'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:00 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:00 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:17:00 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] Creating offline snapshot 1cbe9eea-2cad-4928-8bc3-996a564d0c89 of volume 8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[25231909-0057-429e-862c-ad4d67009404]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:01 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.352s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:17:01 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Deleted volume successfully. Jul 18 06:17:01 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 Jul 18 06:17:01 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-7115d35f-b9ae-4069-9cb9-8032d13d7ec1 tempest-ProjectMemberTests-636800526 None] Lock "cinder-94a85d47-b94c-4924-8799-8fbbdeadd1cf-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:01 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2" returned: 0 in 0.511s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:01 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 1G Jul 18 06:17:01 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (4951d64e-a9ab-4468-a555-035336a6c4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d268c2-d05f-4ffb-8bae-484d0af2643e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d268c2-d05f-4ffb-8bae-484d0af2643e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509692417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5647ce-7a84-4112-9470-3109a59536c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:02Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f913be52-a0fa-4954-aa76-bdd8b2d2d5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f913be52-a0fa-4954-aa76-bdd8b2d2d5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a665fab-b6a6-4b3d-8b3e-7f4a9daad32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a665fab-b6a6-4b3d-8b3e-7f4a9daad32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee5647ce-7a84-4112-9470-3109a59536c5', 'volume_name': 'volume-ee5647ce-7a84-4112-9470-3109a59536c5', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1802a8bb-3721-4fd3-89fc-ea513a277f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1802a8bb-3721-4fd3-89fc-ea513a277f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd19713d-3249-492b-9021-3884be0e6493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:01 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Volume ee5647ce-7a84-4112-9470-3109a59536c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee5647ce-7a84-4112-9470-3109a59536c5', 'volume_size': 1} Jul 18 06:17:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:02 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 1G" returned: 0 in 0.571s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:02 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 Jul 18 06:17:02 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:02 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89" returned: 0 in 0.330s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:02 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 is being set with open permissions: ugo+rw Jul 18 06:17:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:02 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 Jul 18 06:17:02 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:02 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89" returned: 0 in 0.276s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:02 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.info Jul 18 06:17:02 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:03 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.info" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:03 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.info is being set with open permissions: ugo+rw Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:03 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.info Jul 18 06:17:03 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:03 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.info" returned: 0 in 0.272s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-509692417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5647ce-7a84-4112-9470-3109a59536c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:02Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Creating volume ee5647ce-7a84-4112-9470-3109a59536c5 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:17:03 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:03 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 1073741824 Jul 18 06:17:03 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-95963a94-55c7-43e6-93c9-eaf31ccc8133 tempest-ProjectReaderTests-806745192 None] Create snapshot completed successfully Jul 18 06:17:03 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:03 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:03 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 1073741824" returned: 0 in 0.601s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:04 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 Jul 18 06:17:04 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-1cbe9eea-2cad-4928-8bc3-996a564d0c89-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Lock "cinder-1cbe9eea-2cad-4928-8bc3-996a564d0c89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-1cbe9eea-2cad-4928-8bc3-996a564d0c89" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-1cbe9eea-2cad-4928-8bc3-996a564d0c89" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Deleting offline snapshot 1cbe9eea-2cad-4928-8bc3-996a564d0c89 of volume 8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] snapshot_file for this snap is: volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c0207b-7a63-461b-a5fb-f4679ac3459e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:04 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5" returned: 0 in 0.311s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd19713d-3249-492b-9021-3884be0e6493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5647ce-7a84-4112-9470-3109a59536c5', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c426e7d-d375-4083-a324-34a721744b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:04 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Volume volume-ee5647ce-7a84-4112-9470-3109a59536c5 (ee5647ce-7a84-4112-9470-3109a59536c5): created successfully Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c426e7d-d375-4083-a324-34a721744b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (4951d64e-a9ab-4468-a555-035336a6c4ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:04 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-67fdb8b4-1576-48df-ae8a-4f2c359e4a28 tempest-ProjectMemberTests-636800526 None] Created volume successfully. Jul 18 06:17:04 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 Jul 18 06:17:04 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:04 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89" returned: 0 in 0.493s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df404ae-6801-4fc5-8ed1-92630b4dcb6b]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:04 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:05 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 Jul 18 06:17:05 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] Creating offline snapshot a247c890-6acc-43e7-9013-3b48ce8ee590 of volume ee5647ce-7a84-4112-9470-3109a59536c5 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[231ac1e0-3500-40ee-b731-4e563dcb69f1]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:05 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 Jul 18 06:17:05 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:05 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2" returned: 0 in 0.411s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:05 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 Jul 18 06:17:05 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:05 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5" returned: 0 in 0.385s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:05 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 1G Jul 18 06:17:05 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:05 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89" returned: 0 in 0.367s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:05 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89 Jul 18 06:17:05 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:05 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2.1cbe9eea-2cad-4928-8bc3-996a564d0c89" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-1cbe9eea-2cad-4928-8bc3-996a564d0c89" released by "_delete_snapshot" :: held 1.654s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2" released by "delete_snapshot" :: held 1.685s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:05 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 1G" returned: 0 in 0.409s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:05 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee5647ce-7a84-4112-9470-3109a59536c5 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:05 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee5647ce-7a84-4112-9470-3109a59536c5 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 Jul 18 06:17:05 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Created reservations ['b3adf7ce-4b74-41e8-b3b8-a55f07d000b7', 'f93e4ec2-b6fb-4b23-9602-fb3bbe7a2717', '74c0d974-f934-4201-b459-5c120399ef25', 'd0baf419-cbfd-4652-87bc-3e728703b4f6'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:06 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Delete snapshot completed successfully. Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5c1461fe-f3c9-4c2a-8a33-a5e18071e62f tempest-ProjectReaderTests-806745192 None] Lock "cinder-1cbe9eea-2cad-4928-8bc3-996a564d0c89-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:06 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee5647ce-7a84-4112-9470-3109a59536c5 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:06 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 is being set with open permissions: ugo+rw Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:06 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 Jul 18 06:17:06 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Lock "cinder-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d4cb56-c033-48f6-868a-17735e17a654]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:06 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590" returned: 0 in 0.254s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:06 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.info Jul 18 06:17:06 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:06 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 Jul 18 06:17:06 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:06 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.info" returned: 0 in 0.257s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:06 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.info is being set with open permissions: ugo+rw Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:06 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.info Jul 18 06:17:06 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:06 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2" returned: 0 in 0.368s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:06 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2 Jul 18 06:17:06 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:07 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.info" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-a967c208-9b2e-474c-8a84-35529376ad50 tempest-ProjectMemberTests-636800526 None] Create snapshot completed successfully Jul 18 06:17:07 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2" returned: 0 in 0.261s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2" released by "delete_volume" :: held 0.692s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Created reservations ['bc434a29-6e13-4344-adfb-b4165b058ef4', '22338e14-3da5-4bcc-b38a-51c46b7d978d', '89e3e3f8-d6c3-4cb9-b0d4-53dfb2cb8c59', '8acd4da6-c17b-4a00-a319-d7df3b179557'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-a247c890-6acc-43e7-9013-3b48ce8ee590-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:07 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:17:07 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Lock "cinder-a247c890-6acc-43e7-9013-3b48ce8ee590-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-ee5647ce-7a84-4112-9470-3109a59536c5" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-ee5647ce-7a84-4112-9470-3109a59536c5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-a247c890-6acc-43e7-9013-3b48ce8ee590" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-a247c890-6acc-43e7-9013-3b48ce8ee590" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Deleting offline snapshot a247c890-6acc-43e7-9013-3b48ce8ee590 of volume ee5647ce-7a84-4112-9470-3109a59536c5 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] snapshot_file for this snap is: volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec98ac2c-0e5e-4a85-af74-15a17d7ff788]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:07 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 Jul 18 06:17:07 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:07 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:17:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Deleted volume successfully. Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-fcbf51e2-d848-481b-9d08-d6be59118acb tempest-ProjectReaderTests-806745192 None] Lock "cinder-8708a0cb-5f0d-4f65-aefc-a519bfd6d8f2-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:07 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590" returned: 0 in 0.398s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee5647ce-7a84-4112-9470-3109a59536c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2731a83c-159e-406f-8920-f90d71d7f962]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:07 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 Jul 18 06:17:07 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:07 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Flow 'volume_create_manager' (0fc985be-41c7-4686-b309-4160fb3f8e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642a07e8-3d41-44fe-8796-30efdd458a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642a07e8-3d41-44fe-8796-30efdd458a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1134722280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e772fad-753c-4e63-a6eb-aa8f8e2a6752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1674783fd65941bd823a6009ecf58eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:08Z,use_quota=True,user_id='140d1ee20a8c461b80512320ef4b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08419af6-0211-4084-a260-ceedb08c66bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08419af6-0211-4084-a260-ceedb08c66bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84e009a-2beb-47dc-8d0a-45678d05f40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c84e009a-2beb-47dc-8d0a-45678d05f40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e772fad-753c-4e63-a6eb-aa8f8e2a6752', 'volume_name': 'volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2494c939-2377-4ac7-b32d-c329c0c330ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2494c939-2377-4ac7-b32d-c329c0c330ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e998cd-ab26-4437-ab57-2e9ce5fa3ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Volume 7e772fad-753c-4e63-a6eb-aa8f8e2a6752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752', 'volume_size': 1} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1134722280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e772fad-753c-4e63-a6eb-aa8f8e2a6752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1674783fd65941bd823a6009ecf58eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:08Z,use_quota=True,user_id='140d1ee20a8c461b80512320ef4b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Creating volume 7e772fad-753c-4e63-a6eb-aa8f8e2a6752 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:17:08 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:08 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 1073741824 Jul 18 06:17:08 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:08 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5" returned: 0 in 0.374s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:08 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 Jul 18 06:17:08 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:08 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590" returned: 0 in 0.347s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:08 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 1073741824" returned: 0 in 0.434s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:08 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590 Jul 18 06:17:08 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:08 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 Jul 18 06:17:08 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:08 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5.a247c890-6acc-43e7-9013-3b48ce8ee590" returned: 0 in 0.245s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-a247c890-6acc-43e7-9013-3b48ce8ee590" released by "_delete_snapshot" :: held 1.469s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-ee5647ce-7a84-4112-9470-3109a59536c5" released by "delete_snapshot" :: held 1.488s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:08 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752" returned: 0 in 0.249s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e998cd-ab26-4437-ab57-2e9ce5fa3ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c7dd02-5a1e-461a-b2e1-accf0904effb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Volume volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 (7e772fad-753c-4e63-a6eb-aa8f8e2a6752): created successfully Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c7dd02-5a1e-461a-b2e1-accf0904effb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Flow 'volume_create_manager' (0fc985be-41c7-4686-b309-4160fb3f8e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4b1d5be0-b649-4ca6-ada0-7de02607b7d2 tempest-ProjectReaderTests-806745192 None] Created volume successfully. Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Created reservations ['6c67b576-5c24-429c-9246-4a9af422df56', 'fa0cf175-e358-4d4d-a5fd-9eecfe1dcfe2', '73822ca2-1154-4b21-83d8-7a05493f7c68', '390ece34-0d5a-4a64-8423-68d6cecf1c85'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:08 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Delete snapshot completed successfully. Jul 18 06:17:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-04c6ff83-a8fd-4081-bfad-bcf579e60a3f tempest-ProjectMemberTests-636800526 None] Lock "cinder-a247c890-6acc-43e7-9013-3b48ce8ee590-delete_snapshot" released by "delete_snapshot" :: held 1.663s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] Creating offline snapshot b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 of volume 7e772fad-753c-4e63-a6eb-aa8f8e2a6752 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a41d8b1-7045-4455-998c-5363b31f8e54]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:09 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 Jul 18 06:17:09 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-ee5647ce-7a84-4112-9470-3109a59536c5-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Lock "cinder-ee5647ce-7a84-4112-9470-3109a59536c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-ee5647ce-7a84-4112-9470-3109a59536c5" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-ee5647ce-7a84-4112-9470-3109a59536c5" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a04e12-d654-465f-b1e6-d027bb9d4766]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:09 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752" returned: 0 in 0.362s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:09 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 1G Jul 18 06:17:09 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:09 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 Jul 18 06:17:09 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:09 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5" returned: 0 in 0.373s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:09 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5 Jul 18 06:17:09 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:10 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 1G" returned: 0 in 0.408s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:10 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 Jul 18 06:17:10 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:10 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ee5647ce-7a84-4112-9470-3109a59536c5" returned: 0 in 0.252s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-ee5647ce-7a84-4112-9470-3109a59536c5" released by "delete_volume" :: held 0.692s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Created reservations ['d2549475-443f-4259-9fc8-686ec409474a', '89f40731-4269-402c-892e-e4c3f7d6227c', 'b01d5705-439f-46e2-a9b1-5bd7734c6c3c', '7d900e8f-735b-4bee-ba0d-be21e46ca2f8'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:10 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:17:10 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:10 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5" returned: 0 in 0.317s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:10 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 is being set with open permissions: ugo+rw Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:10 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 Jul 18 06:17:10 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:10 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.244s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:17:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Deleted volume successfully. Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-794d7c59-6298-4ba0-b96b-e42c3bb78637 tempest-ProjectMemberTests-636800526 None] Lock "cinder-ee5647ce-7a84-4112-9470-3109a59536c5-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:10 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5" returned: 0 in 0.253s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:10 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.info Jul 18 06:17:10 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:10 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.info" returned: 0 in 0.275s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:10 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.info is being set with open permissions: ugo+rw Jul 18 06:17:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:10 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.info Jul 18 06:17:10 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (755183f4-b98e-4e82-be8b-ff9b68399b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc30c019-60f8-490a-816a-f91421c03342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc30c019-60f8-490a-816a-f91421c03342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1566204842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117f7ea6-6129-43b7-868d-7f831ed66e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:11Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e7b23a-049b-4f97-abfa-4a193d70f756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e7b23a-049b-4f97-abfa-4a193d70f756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70515527-225b-44ed-b58c-ea7e2b3df4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70515527-225b-44ed-b58c-ea7e2b3df4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '117f7ea6-6129-43b7-868d-7f831ed66e3f', 'volume_name': 'volume-117f7ea6-6129-43b7-868d-7f831ed66e3f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec2426a-6ca2-4109-9b8d-ef44968fa2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ec2426a-6ca2-4109-9b8d-ef44968fa2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51765b6b-0dc7-4235-b2e6-8317b454ef61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:11 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Volume 117f7ea6-6129-43b7-868d-7f831ed66e3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-117f7ea6-6129-43b7-868d-7f831ed66e3f', 'volume_size': 1} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:11 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.info" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.030s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1566204842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=117f7ea6-6129-43b7-868d-7f831ed66e3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:11Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Creating volume 117f7ea6-6129-43b7-868d-7f831ed66e3f {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:17:11 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:11 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f 1073741824 Jul 18 06:17:11 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-914a0cc1-7c48-42ff-abed-dc468c88f150 tempest-ProjectReaderTests-806745192 None] Create snapshot completed successfully Jul 18 06:17:11 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f 1073741824" returned: 0 in 0.403s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:11 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f Jul 18 06:17:11 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:11 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51765b6b-0dc7-4235-b2e6-8317b454ef61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-117f7ea6-6129-43b7-868d-7f831ed66e3f', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebd179e-aa32-4d5a-b407-6db8b5b323b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:11 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Volume volume-117f7ea6-6129-43b7-868d-7f831ed66e3f (117f7ea6-6129-43b7-868d-7f831ed66e3f): created successfully Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebd179e-aa32-4d5a-b407-6db8b5b323b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (755183f4-b98e-4e82-be8b-ff9b68399b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3204d449-63d2-4d8a-96c3-5506c4df1546 tempest-ProjectMemberTests-636800526 None] Created volume successfully. Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] Creating offline snapshot ec3f6d58-c70e-419d-92c3-4435d2a77a8c of volume 117f7ea6-6129-43b7-868d-7f831ed66e3f {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f46a05-3924-4619-bdb6-fddbd28d53fb]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:12 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f Jul 18 06:17:12 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-b49974b4-8ad4-4c69-ad7f-424cfbd27fc5-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Lock "cinder-b49974b4-8ad4-4c69-ad7f-424cfbd27fc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-7e772fad-753c-4e63-a6eb-aa8f8e2a6752" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-7e772fad-753c-4e63-a6eb-aa8f8e2a6752" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-b49974b4-8ad4-4c69-ad7f-424cfbd27fc5" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-b49974b4-8ad4-4c69-ad7f-424cfbd27fc5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Deleting offline snapshot b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 of volume 7e772fad-753c-4e63-a6eb-aa8f8e2a6752 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] snapshot_file for this snap is: volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3190a3f-4dd3-4e5f-b9e2-3da395c40ad1]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:12 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 Jul 18 06:17:12 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:12 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f" returned: 0 in 0.401s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:12 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c 1G Jul 18 06:17:12 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:12 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5" returned: 0 in 0.364s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd20e50-ad8e-4cd0-a4ec-664e96717203]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:12 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 Jul 18 06:17:12 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:13 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c 1G" returned: 0 in 0.427s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f7ea6-6129-43b7-868d-7f831ed66e3f -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:13 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f7ea6-6129-43b7-868d-7f831ed66e3f -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c Jul 18 06:17:13 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:13 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752" returned: 0 in 0.395s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:13 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 Jul 18 06:17:13 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:13 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-117f7ea6-6129-43b7-868d-7f831ed66e3f -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c" returned: 0 in 0.292s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:13 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c is being set with open permissions: ugo+rw Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:13 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c Jul 18 06:17:13 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:13 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:13 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c" returned: 0 in 0.266s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5" returned: 0 in 0.385s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:13 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5 Jul 18 06:17:13 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:13 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.info Jul 18 06:17:13 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:13 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752.b49974b4-8ad4-4c69-ad7f-424cfbd27fc5" returned: 0 in 0.249s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-b49974b4-8ad4-4c69-ad7f-424cfbd27fc5" released by "_delete_snapshot" :: held 1.499s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-7e772fad-753c-4e63-a6eb-aa8f8e2a6752" released by "delete_snapshot" :: held 1.526s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:13 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.info" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:13 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.info is being set with open permissions: ugo+rw Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:13 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.info Jul 18 06:17:13 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:13 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Created reservations ['ced2a2fa-3712-4d22-a5d7-b2661881e520', '2abe12a8-ae09-4cb0-9abe-b1fedb25dff2', '4b7aaf8d-31b7-4235-93d1-a3875eee0c5f', 'f303535e-beaf-4b21-9f8c-663be070e975'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Delete snapshot completed successfully. Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-9dc37ce5-7f87-4fb1-9577-8897ac6a0158 tempest-ProjectReaderTests-806745192 None] Lock "cinder-b49974b4-8ad4-4c69-ad7f-424cfbd27fc5-delete_snapshot" released by "delete_snapshot" :: held 1.677s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:14 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.info" returned: 0 in 0.241s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-67a41d98-9c21-494e-80af-72385de2e884 tempest-ProjectMemberTests-636800526 None] Create snapshot completed successfully Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-ec3f6d58-c70e-419d-92c3-4435d2a77a8c-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Lock "cinder-ec3f6d58-c70e-419d-92c3-4435d2a77a8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-117f7ea6-6129-43b7-868d-7f831ed66e3f" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-117f7ea6-6129-43b7-868d-7f831ed66e3f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-ec3f6d58-c70e-419d-92c3-4435d2a77a8c" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-ec3f6d58-c70e-419d-92c3-4435d2a77a8c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Deleting offline snapshot ec3f6d58-c70e-419d-92c3-4435d2a77a8c of volume 117f7ea6-6129-43b7-868d-7f831ed66e3f {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] snapshot_file for this snap is: volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b02e3d-2e3e-4657-bbf9-ed47947b6c25]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:14 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c Jul 18 06:17:14 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-7e772fad-753c-4e63-a6eb-aa8f8e2a6752-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Lock "cinder-7e772fad-753c-4e63-a6eb-aa8f8e2a6752-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-7e772fad-753c-4e63-a6eb-aa8f8e2a6752" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-7e772fad-753c-4e63-a6eb-aa8f8e2a6752" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62aa6f0-7464-4442-b3de-52993292164a]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:14 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 Jul 18 06:17:14 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:14 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c" returned: 0 in 0.388s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-117f7ea6-6129-43b7-868d-7f831ed66e3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0650d615-2a31-44bb-8ef8-2edb20e84916]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:14 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f Jul 18 06:17:14 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:14 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752" returned: 0 in 0.385s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:15 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752 Jul 18 06:17:15 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:15 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f" returned: 0 in 0.354s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:15 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c Jul 18 06:17:15 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:15 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7e772fad-753c-4e63-a6eb-aa8f8e2a6752" returned: 0 in 0.258s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-7e772fad-753c-4e63-a6eb-aa8f8e2a6752" released by "delete_volume" :: held 0.700s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Created reservations ['c7529e82-d12c-47e5-9826-00ce902a3868', '6d004e9a-c30f-46a8-a881-cd7ef1a0548e', '8b11d4bc-8e47-447f-be8e-4eaf5d5b9f98', '1094544a-4f4a-47b4-a3d9-3f5f78be63c3'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:15 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:17:15 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:15 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c" returned: 0 in 0.333s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:15 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c Jul 18 06:17:15 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:15 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.254s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:17:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Deleted volume successfully. Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-6144b1f0-9754-4019-9643-6c51be50d557 tempest-ProjectReaderTests-806745192 None] Lock "cinder-7e772fad-753c-4e63-a6eb-aa8f8e2a6752-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:15 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f.ec3f6d58-c70e-419d-92c3-4435d2a77a8c" returned: 0 in 0.281s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-ec3f6d58-c70e-419d-92c3-4435d2a77a8c" released by "_delete_snapshot" :: held 1.464s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-117f7ea6-6129-43b7-868d-7f831ed66e3f" released by "delete_snapshot" :: held 1.488s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Created reservations ['af09fb2a-e2fb-4683-afd3-ac000d691ced', 'b530e810-6b2a-4d3b-b5e3-34f5a8b2193b', 'cd9e2e36-75e1-40eb-be9a-9c2f006f7e29', '856ea8d1-9ac7-40b9-98f1-59e006d4fe10'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:15 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Delete snapshot completed successfully. Jul 18 06:17:15 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-cfa164b3-9636-4ac2-b440-8d71ee67bbce tempest-ProjectMemberTests-636800526 None] Lock "cinder-ec3f6d58-c70e-419d-92c3-4435d2a77a8c-delete_snapshot" released by "delete_snapshot" :: held 1.631s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Flow 'volume_create_manager' (57a98111-57c8-40d1-b8ee-6e843b692e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeaa755f-260d-4e8c-8190-1af23de6bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeaa755f-260d-4e8c-8190-1af23de6bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447888702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dbed751-143c-4fa5-a0b7-ec17a28c142c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1674783fd65941bd823a6009ecf58eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:16Z,use_quota=True,user_id='140d1ee20a8c461b80512320ef4b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175294ce-8de8-4953-9507-a020be3cedd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175294ce-8de8-4953-9507-a020be3cedd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97825543-d3f8-4ffc-a299-186b71354085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97825543-d3f8-4ffc-a299-186b71354085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dbed751-143c-4fa5-a0b7-ec17a28c142c', 'volume_name': 'volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ead26ae-1ee1-4d3d-a8ec-a580fc7e5143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ead26ae-1ee1-4d3d-a8ec-a580fc7e5143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c578ed-5d35-4e5a-84b3-b905ec587a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Volume 7dbed751-143c-4fa5-a0b7-ec17a28c142c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c', 'volume_size': 1} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447888702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dbed751-143c-4fa5-a0b7-ec17a28c142c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1674783fd65941bd823a6009ecf58eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:16Z,use_quota=True,user_id='140d1ee20a8c461b80512320ef4b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Creating volume 7dbed751-143c-4fa5-a0b7-ec17a28c142c {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:17:16 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:16 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c 1073741824 Jul 18 06:17:16 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-117f7ea6-6129-43b7-868d-7f831ed66e3f-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Lock "cinder-117f7ea6-6129-43b7-868d-7f831ed66e3f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-117f7ea6-6129-43b7-868d-7f831ed66e3f" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-117f7ea6-6129-43b7-868d-7f831ed66e3f" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05df78f-2d4e-429d-85f7-823a579b508f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:16 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c 1073741824" returned: 0 in 0.454s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:16 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f Jul 18 06:17:16 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:16 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c Jul 18 06:17:16 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:16 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c" returned: 0 in 0.233s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c578ed-5d35-4e5a-84b3-b905ec587a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f415d3-176a-4249-88b6-920aa550ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:16 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Volume volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c (7dbed751-143c-4fa5-a0b7-ec17a28c142c): created successfully Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f415d3-176a-4249-88b6-920aa550ff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:16 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f Jul 18 06:17:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Flow 'volume_create_manager' (57a98111-57c8-40d1-b8ee-6e843b692e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:16 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9704275c-4ea9-46ca-80c0-72a4c33b816c tempest-ProjectReaderTests-806745192 None] Created volume successfully. Jul 18 06:17:17 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-117f7ea6-6129-43b7-868d-7f831ed66e3f" returned: 0 in 0.246s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-117f7ea6-6129-43b7-868d-7f831ed66e3f" released by "delete_volume" :: held 0.683s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Created reservations ['d459c8d2-9b52-4a54-b4d1-4ddd1b9e00b6', 'ab471e92-1992-43c5-86ff-29bbf716429f', 'b8a0f7e3-bec2-4a70-9d6c-1183f8db4916', 'f6ab497b-96b3-49d5-b69e-c3e2bfc9da22'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] Creating offline snapshot e2243379-b61d-483f-ae8a-87e229e6be2d of volume 7dbed751-143c-4fa5-a0b7-ec17a28c142c {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[213e3ce6-fbd6-45b4-bbf6-69b65c625a18]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:17 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:17:17 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:17 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c Jul 18 06:17:17 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:17 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.264s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:17:17 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Deleted volume successfully. Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-4d1f584b-bf45-4c93-9d56-6763d8f39253 tempest-ProjectMemberTests-636800526 None] Lock "cinder-117f7ea6-6129-43b7-868d-7f831ed66e3f-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:17 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:17 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d 1G Jul 18 06:17:17 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (6fd819de-1c2e-43a8-8bfa-8d20139bbad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf39b54-cdd9-4c28-9059-c1dac526b0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf39b54-cdd9-4c28-9059-c1dac526b0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847505924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:18Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc52c85-0c28-42c3-a185-1f111bf3a417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:18 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc52c85-0c28-42c3-a185-1f111bf3a417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3104f700-a7f3-4f03-94f1-fc736cdb9ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3104f700-a7f3-4f03-94f1-fc736cdb9ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e', 'volume_name': 'volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f44b45b-b467-4b72-ab07-94e87c83dc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f44b45b-b467-4b72-ab07-94e87c83dc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b1a4bb-6e42-47dc-a925-24617ad1a163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:18 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Volume a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e', 'volume_size': 1} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d 1G" returned: 0 in 0.452s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:18 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d Jul 18 06:17:18 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:18 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d" returned: 0 in 0.286s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:18 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d is being set with open permissions: ugo+rw Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:18 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d Jul 18 06:17:18 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:18 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d" returned: 0 in 0.244s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:18 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.info Jul 18 06:17:18 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:18 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.info" returned: 0 in 0.244s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:18 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.info is being set with open permissions: ugo+rw Jul 18 06:17:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:18 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.info Jul 18 06:17:18 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:19 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.info" returned: 0 in 0.240s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.059s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1847505924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:18Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Creating volume a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:17:19 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:19 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e 1073741824 Jul 18 06:17:19 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-41284ad2-d0bd-488f-ba52-f92a4601e58a tempest-ProjectReaderTests-806745192 None] Create snapshot completed successfully Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-e2243379-b61d-483f-ae8a-87e229e6be2d-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Lock "cinder-e2243379-b61d-483f-ae8a-87e229e6be2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-7dbed751-143c-4fa5-a0b7-ec17a28c142c" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-7dbed751-143c-4fa5-a0b7-ec17a28c142c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-e2243379-b61d-483f-ae8a-87e229e6be2d" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-e2243379-b61d-483f-ae8a-87e229e6be2d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Deleting offline snapshot e2243379-b61d-483f-ae8a-87e229e6be2d of volume 7dbed751-143c-4fa5-a0b7-ec17a28c142c {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] snapshot_file for this snap is: volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[af50c191-6a9d-4991-bac0-8d2316162a6e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:19 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d Jul 18 06:17:19 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:19 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e 1073741824" returned: 0 in 0.450s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:19 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e Jul 18 06:17:19 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:19 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d" returned: 0 in 0.369s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[233ffa57-bc35-481c-b6ce-b64e70cc17e6]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:19 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e" returned: 0 in 0.272s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b1a4bb-6e42-47dc-a925-24617ad1a163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d826625b-8574-4205-b783-757033cfd403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:20 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Volume volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e (a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e): created successfully Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d826625b-8574-4205-b783-757033cfd403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (6fd819de-1c2e-43a8-8bfa-8d20139bbad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:20 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b40d3766-c74b-46f4-ab5f-f677e3df406b tempest-ProjectMemberTests-636800526 None] Created volume successfully. Jul 18 06:17:20 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c Jul 18 06:17:20 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] Creating offline snapshot 87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 of volume a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:17:20 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c" returned: 0 in 0.395s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa50b2b8-2dfe-4e2a-9c07-db1fa4e7180e]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:20 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d Jul 18 06:17:20 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:20 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e Jul 18 06:17:20 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:20 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d" returned: 0 in 0.342s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:20 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d Jul 18 06:17:20 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:20 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e" returned: 0 in 0.392s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:20 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 1G Jul 18 06:17:20 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:20 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c.e2243379-b61d-483f-ae8a-87e229e6be2d" returned: 0 in 0.247s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-e2243379-b61d-483f-ae8a-87e229e6be2d" released by "_delete_snapshot" :: held 1.448s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-7dbed751-143c-4fa5-a0b7-ec17a28c142c" released by "delete_snapshot" :: held 1.473s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Created reservations ['a9770abc-0434-42f7-8d69-ba8f79300969', 'a6057641-3155-4084-8706-34b65ed9da31', 'f06a024a-e11b-4db7-8614-813cbcfa175a', '01d8f5b4-224a-42ba-9ed8-80d2c5af448d'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Delete snapshot completed successfully. Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-f5cf4d33-61df-4668-a7c9-306203d947d6 tempest-ProjectReaderTests-806745192 None] Lock "cinder-e2243379-b61d-483f-ae8a-87e229e6be2d-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:21 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 1G" returned: 0 in 0.437s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:21 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 Jul 18 06:17:21 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:21 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1" returned: 0 in 0.286s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:21 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 is being set with open permissions: ugo+rw Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:21 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 Jul 18 06:17:21 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-7dbed751-143c-4fa5-a0b7-ec17a28c142c-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Lock "cinder-7dbed751-143c-4fa5-a0b7-ec17a28c142c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-7dbed751-143c-4fa5-a0b7-ec17a28c142c" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-7dbed751-143c-4fa5-a0b7-ec17a28c142c" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:21 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1" returned: 0 in 0.274s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa58264a-52e7-470e-bfdb-4b0cf142c595]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:21 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.info Jul 18 06:17:21 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:21 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c Jul 18 06:17:21 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:22 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.info" returned: 0 in 0.264s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:22 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.info is being set with open permissions: ugo+rw Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:22 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.info Jul 18 06:17:22 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:22 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c" returned: 0 in 0.368s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:22 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c Jul 18 06:17:22 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:22 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.info" returned: 0 in 0.264s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-9a2f6f23-504b-4a4a-884e-a3948edb13bf tempest-ProjectMemberTests-636800526 None] Create snapshot completed successfully Jul 18 06:17:22 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-7dbed751-143c-4fa5-a0b7-ec17a28c142c" returned: 0 in 0.261s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-7dbed751-143c-4fa5-a0b7-ec17a28c142c" released by "delete_volume" :: held 0.691s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Created reservations ['ab0be5d0-3cbc-49bb-9d7e-446554c79305', '452c948f-2da3-448f-bbd7-9c44d22fae9c', '81435c31-92c0-439f-973b-7a3fd65a3032', '0452e3e7-346a-4755-b4b4-27d6653549ff'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:22 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:17:22 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:22 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.270s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:17:22 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Deleted volume successfully. Jul 18 06:17:22 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-12761946-9bfc-4aee-a04e-fdb0e50f6a12 tempest-ProjectReaderTests-806745192 None] Lock "cinder-7dbed751-143c-4fa5-a0b7-ec17a28c142c-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Flow 'volume_create_manager' (41a11cf1-073b-4b15-b9ac-a126fb5465dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c26cacf-acbe-486b-9e15-602499079344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c26cacf-acbe-486b-9e15-602499079344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1710067594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8561a04-66d1-4abb-831e-a3ac527ff95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1674783fd65941bd823a6009ecf58eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:23Z,use_quota=True,user_id='140d1ee20a8c461b80512320ef4b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a079aa0-62b4-4701-92e2-218ffaab1925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a079aa0-62b4-4701-92e2-218ffaab1925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04c89a3-53ed-4f46-a864-8f7805a2619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04c89a3-53ed-4f46-a864-8f7805a2619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8561a04-66d1-4abb-831e-a3ac527ff95b', 'volume_name': 'volume-e8561a04-66d1-4abb-831e-a3ac527ff95b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81b41e6-e8fa-4306-94aa-0763f32bdec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81b41e6-e8fa-4306-94aa-0763f32bdec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1c0ae7-55f3-49f9-bf76-169e72a7e33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:23 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Volume e8561a04-66d1-4abb-831e-a3ac527ff95b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8561a04-66d1-4abb-831e-a3ac527ff95b', 'volume_size': 1} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1710067594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8561a04-66d1-4abb-831e-a3ac527ff95b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1674783fd65941bd823a6009ecf58eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:23Z,use_quota=True,user_id='140d1ee20a8c461b80512320ef4b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Creating volume e8561a04-66d1-4abb-831e-a3ac527ff95b {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:17:23 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:23 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b 1073741824 Jul 18 06:17:23 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-87efe922-aa95-4a83-9c99-bb7d1ff9e3c1-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Lock "cinder-87efe922-aa95-4a83-9c99-bb7d1ff9e3c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-87efe922-aa95-4a83-9c99-bb7d1ff9e3c1" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-87efe922-aa95-4a83-9c99-bb7d1ff9e3c1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Deleting offline snapshot 87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 of volume a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] snapshot_file for this snap is: volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb42b95-1468-452b-a3f9-a29d8027fbc0]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:23 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 Jul 18 06:17:23 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:23 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b 1073741824" returned: 0 in 0.422s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:23 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b Jul 18 06:17:23 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:23 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1" returned: 0 in 0.369s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b1bafb-4c69-4db5-8e48-6d6ae3fb37e5]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:23 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b" returned: 0 in 0.245s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:17:23 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1c0ae7-55f3-49f9-bf76-169e72a7e33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8561a04-66d1-4abb-831e-a3ac527ff95b', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da04b933-f982-4265-8be3-7425a2674dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:24 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Volume volume-e8561a04-66d1-4abb-831e-a3ac527ff95b (e8561a04-66d1-4abb-831e-a3ac527ff95b): created successfully Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da04b933-f982-4265-8be3-7425a2674dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Flow 'volume_create_manager' (41a11cf1-073b-4b15-b9ac-a126fb5465dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:24 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b182601f-fafb-4ba6-b9a1-04e8f96fc885 tempest-ProjectReaderTests-806745192 None] Created volume successfully. Jul 18 06:17:24 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e Jul 18 06:17:24 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:24 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e" returned: 0 in 0.390s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:24 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 Jul 18 06:17:24 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] Creating offline snapshot e7bc413d-4b2b-4877-97a6-3d0a38d8d070 of volume e8561a04-66d1-4abb-831e-a3ac527ff95b {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b09640-dbbd-4bee-b03f-b5804ff38863]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:24 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b Jul 18 06:17:24 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:24 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1" returned: 0 in 0.370s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:24 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1 Jul 18 06:17:24 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:24 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:24 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 1G Jul 18 06:17:24 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:24 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e.87efe922-aa95-4a83-9c99-bb7d1ff9e3c1" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-87efe922-aa95-4a83-9c99-bb7d1ff9e3c1" released by "_delete_snapshot" :: held 1.478s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:24 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e" released by "delete_snapshot" :: held 1.503s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Created reservations ['10805db3-ef86-46da-a161-c4071e8e899b', 'd5beb3b0-e847-4784-b63c-50e9bfcb14c1', 'e8a7aa46-63cd-4a54-b301-213ab6e8f6f6', '3f594a94-903f-4990-89d3-0a4bbed3a3f0'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:25 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Delete snapshot completed successfully. Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0c207676-12d5-4f15-ad8f-a2c2f13e693a tempest-ProjectMemberTests-636800526 None] Lock "cinder-87efe922-aa95-4a83-9c99-bb7d1ff9e3c1-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:25 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 1G" returned: 0 in 0.415s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8561a04-66d1-4abb-831e-a3ac527ff95b -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:25 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8561a04-66d1-4abb-831e-a3ac527ff95b -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 Jul 18 06:17:25 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:25 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8561a04-66d1-4abb-831e-a3ac527ff95b -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070" returned: 0 in 0.286s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:25 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 is being set with open permissions: ugo+rw Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:25 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 Jul 18 06:17:25 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Lock "cinder-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c63518b-e5a0-4340-a889-8a072e825e7f]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:25 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:25 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:25 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.info Jul 18 06:17:25 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:25 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e Jul 18 06:17:25 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:26 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.info" returned: 0 in 0.261s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:26 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.info is being set with open permissions: ugo+rw Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:26 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e" returned: 0 in 0.369s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:26 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.info Jul 18 06:17:26 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:26 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e Jul 18 06:17:26 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:26 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.info" returned: 0 in 0.250s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:26 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e" returned: 0 in 0.254s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e" released by "delete_volume" :: held 0.695s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b0d114c9-bed4-4346-a742-1f05af6d5723 tempest-ProjectReaderTests-806745192 None] Create snapshot completed successfully Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Created reservations ['bff701cc-dcce-4a19-9591-5b19385d8a82', '7553261a-3bc5-4f39-92c2-2bfa80865f1c', 'c0b770fb-9865-450e-a4c5-0773f88fd2c4', '2a103a0d-051f-43f6-be04-45330ccae04a'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-e7bc413d-4b2b-4877-97a6-3d0a38d8d070-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:26 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:17:26 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Lock "cinder-e7bc413d-4b2b-4877-97a6-3d0a38d8d070-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-e8561a04-66d1-4abb-831e-a3ac527ff95b" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-e8561a04-66d1-4abb-831e-a3ac527ff95b" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-e7bc413d-4b2b-4877-97a6-3d0a38d8d070" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-e7bc413d-4b2b-4877-97a6-3d0a38d8d070" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Deleting offline snapshot e7bc413d-4b2b-4877-97a6-3d0a38d8d070 of volume e8561a04-66d1-4abb-831e-a3ac527ff95b {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] snapshot_file for this snap is: volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2ad261-d866-4c0b-9dd1-d86415532607]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:26 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 Jul 18 06:17:26 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:26 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.280s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:17:26 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Deleted volume successfully. Jul 18 06:17:26 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e95d80c7-6242-4ed9-a5bf-31fa4ff3498c tempest-ProjectMemberTests-636800526 None] Lock "cinder-a8cd9c6c-5ce1-4091-aae9-ed3a99b3118e-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:27 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070" returned: 0 in 0.400s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8561a04-66d1-4abb-831e-a3ac527ff95b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8664215e-1798-45e4-9197-0fdc30e00163]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:27 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b Jul 18 06:17:27 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (8fdadefe-76a3-4430-92e2-e62dc92b36be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e56878-85f4-4683-899c-32f43b6474b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e56878-85f4-4683-899c-32f43b6474b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499042712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340827cf-ddca-4c09-af62-d82ed0a13955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:27Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179b8e6b-7cbe-414a-b6ae-431a99bb2da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179b8e6b-7cbe-414a-b6ae-431a99bb2da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25186679-d2d8-48d5-9aad-0fab2a37319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25186679-d2d8-48d5-9aad-0fab2a37319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340827cf-ddca-4c09-af62-d82ed0a13955', 'volume_name': 'volume-340827cf-ddca-4c09-af62-d82ed0a13955', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffbb17b-02e0-4312-957b-3208ef63016b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffbb17b-02e0-4312-957b-3208ef63016b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1684126d-647a-4b2e-ad35-679da55882ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:27 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Volume 340827cf-ddca-4c09-af62-d82ed0a13955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340827cf-ddca-4c09-af62-d82ed0a13955', 'volume_size': 1} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499042712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340827cf-ddca-4c09-af62-d82ed0a13955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:27Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Creating volume 340827cf-ddca-4c09-af62-d82ed0a13955 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:17:27 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:27 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 1073741824 Jul 18 06:17:27 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:27 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b" returned: 0 in 0.397s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:27 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 Jul 18 06:17:27 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:27 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 1073741824" returned: 0 in 0.470s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:27 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070" returned: 0 in 0.402s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:27 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:27 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070 Jul 18 06:17:27 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:27 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 Jul 18 06:17:27 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:28 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b.e7bc413d-4b2b-4877-97a6-3d0a38d8d070" returned: 0 in 0.248s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:28 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955" returned: 0 in 0.250s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-e7bc413d-4b2b-4877-97a6-3d0a38d8d070" released by "_delete_snapshot" :: held 1.555s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1684126d-647a-4b2e-ad35-679da55882ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340827cf-ddca-4c09-af62-d82ed0a13955', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29675145-5f41-4e62-8593-1fc5e9d8ea33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-e8561a04-66d1-4abb-831e-a3ac527ff95b" released by "delete_snapshot" :: held 1.586s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:28 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Volume volume-340827cf-ddca-4c09-af62-d82ed0a13955 (340827cf-ddca-4c09-af62-d82ed0a13955): created successfully Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29675145-5f41-4e62-8593-1fc5e9d8ea33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (8fdadefe-76a3-4430-92e2-e62dc92b36be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-93689300-df49-420d-a3ef-645788e65f15 tempest-ProjectMemberTests-636800526 None] Created volume successfully. Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Created reservations ['368d1b8f-b564-4cbf-9558-ffe955bcfcd2', '64787474-6e34-4f35-86ef-8533b70e68db', '44ed6f84-7fa6-44e5-835f-2dfe17d366f7', '5738b6aa-c2ae-47a7-bd47-83adc521b300'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:28 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Delete snapshot completed successfully. Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-3dd921fc-5ca5-4354-9998-ef68d546d9e5 tempest-ProjectReaderTests-806745192 None] Lock "cinder-e7bc413d-4b2b-4877-97a6-3d0a38d8d070-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-e8561a04-66d1-4abb-831e-a3ac527ff95b-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Lock "cinder-e8561a04-66d1-4abb-831e-a3ac527ff95b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Acquiring lock "cinder-quobyte-e8561a04-66d1-4abb-831e-a3ac527ff95b" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-e8561a04-66d1-4abb-831e-a3ac527ff95b" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e95c02f-ebce-4418-a3ae-f48fdac522be]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:28 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:28 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b Jul 18 06:17:28 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:29 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b" returned: 0 in 0.343s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:29 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b Jul 18 06:17:29 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:29 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-e8561a04-66d1-4abb-831e-a3ac527ff95b" returned: 0 in 0.234s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Lock "cinder-quobyte-e8561a04-66d1-4abb-831e-a3ac527ff95b" released by "delete_volume" :: held 0.630s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Created reservations ['b6e13209-7ced-4617-a39d-9fbae40f6e9f', 'cb805691-93af-46f1-b70e-6dd0c3857a59', '068f8c19-7a19-4fe2-8873-cab79da72003', '22c39069-d766-42a1-a75b-d9bb3cdc0e41'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] Creating offline snapshot 19f6bfe1-0d66-46be-90ce-8ec500d7f1cd of volume 340827cf-ddca-4c09-af62-d82ed0a13955 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d4c08c-6d33-4627-add0-087fc76554d4]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:29 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:17:29 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:29 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 Jul 18 06:17:29 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:29 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.249s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:17:29 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Deleted volume successfully. Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0f1680d4-72a6-4d9d-a26e-3138005f5cb4 tempest-ProjectReaderTests-806745192 None] Lock "cinder-e8561a04-66d1-4abb-831e-a3ac527ff95b-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:29 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955" returned: 0 in 0.376s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:29 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:29 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd 1G Jul 18 06:17:29 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:30 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd 1G" returned: 0 in 0.386s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-340827cf-ddca-4c09-af62-d82ed0a13955 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:30 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-340827cf-ddca-4c09-af62-d82ed0a13955 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd Jul 18 06:17:30 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:30 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-340827cf-ddca-4c09-af62-d82ed0a13955 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd" returned: 0 in 0.299s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:30 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd is being set with open permissions: ugo+rw Jul 18 06:17:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:30 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd Jul 18 06:17:30 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:30 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd" returned: 0 in 0.259s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:30 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:30 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.info Jul 18 06:17:30 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:31 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.info" returned: 0 in 0.283s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:31 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.info is being set with open permissions: ugo+rw Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:31 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.info Jul 18 06:17:31 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:31 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.info" returned: 0 in 0.260s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.951s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:31 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-14d4bbe1-d1bc-4472-ac32-d3d7ab74b060 tempest-ProjectMemberTests-636800526 None] Create snapshot completed successfully Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-19f6bfe1-0d66-46be-90ce-8ec500d7f1cd-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Lock "cinder-19f6bfe1-0d66-46be-90ce-8ec500d7f1cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-340827cf-ddca-4c09-af62-d82ed0a13955" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-340827cf-ddca-4c09-af62-d82ed0a13955" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-19f6bfe1-0d66-46be-90ce-8ec500d7f1cd" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-19f6bfe1-0d66-46be-90ce-8ec500d7f1cd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Deleting offline snapshot 19f6bfe1-0d66-46be-90ce-8ec500d7f1cd of volume 340827cf-ddca-4c09-af62-d82ed0a13955 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] snapshot_file for this snap is: volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f553b8-d94b-45de-aa79-54e5fcd0da16]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:31 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:31 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd Jul 18 06:17:31 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:32 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:32 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-340827cf-ddca-4c09-af62-d82ed0a13955(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:17:32 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff69093-0fbc-42bd-b664-33d0b2e8d079]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:32 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 Jul 18 06:17:32 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:32 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955" returned: 0 in 0.355s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:32 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd Jul 18 06:17:32 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:32 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd" returned: 0 in 0.336s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:32 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:32 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd Jul 18 06:17:32 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:33 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955.19f6bfe1-0d66-46be-90ce-8ec500d7f1cd" returned: 0 in 0.279s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-19f6bfe1-0d66-46be-90ce-8ec500d7f1cd" released by "_delete_snapshot" :: held 1.445s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-340827cf-ddca-4c09-af62-d82ed0a13955" released by "delete_snapshot" :: held 1.468s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:33 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Created reservations ['89ce6457-0552-4367-bc59-42124580a0fd', '94536cc3-fc15-483d-9820-713f664b0d6a', '883f7be4-ad5d-4a26-9593-792fa0818d2b', '1fba77f8-67a0-4b23-b446-ab5b937cb27e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:33 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Delete snapshot completed successfully. Jul 18 06:17:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-47af363c-7210-47bf-b99d-9c13b6b36f38 tempest-ProjectMemberTests-636800526 None] Lock "cinder-19f6bfe1-0d66-46be-90ce-8ec500d7f1cd-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-340827cf-ddca-4c09-af62-d82ed0a13955-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Lock "cinder-340827cf-ddca-4c09-af62-d82ed0a13955-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-340827cf-ddca-4c09-af62-d82ed0a13955" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:33 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-340827cf-ddca-4c09-af62-d82ed0a13955" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:33 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[523d2e42-1c10-4938-8051-290c735a51c9]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:33 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:34 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 Jul 18 06:17:34 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:34 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955" returned: 0 in 0.367s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:34 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955 Jul 18 06:17:34 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:34 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-340827cf-ddca-4c09-af62-d82ed0a13955" returned: 0 in 0.249s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-340827cf-ddca-4c09-af62-d82ed0a13955" released by "delete_volume" :: held 0.674s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Created reservations ['a1ab7311-700a-41f6-820d-f2d8d893f098', 'b47d100b-f1d6-461f-8da3-29333ded883f', '75533205-30e5-48dc-8047-c2cf29e78d26', 'ea8cf851-3682-4a93-bc95-25b80237258b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:34 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:17:34 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:34 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.252s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:17:34 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Deleted volume successfully. Jul 18 06:17:34 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e4ea1b05-50ee-484d-a46c-55271868d8d2 tempest-ProjectMemberTests-636800526 None] Lock "cinder-340827cf-ddca-4c09-af62-d82ed0a13955-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:35 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:17:35 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:17:35 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (dfeff624-8ff0-4157-9c79-50fea5a88f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30296cdc-7b08-4577-9a23-3b78bee91121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.303s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30296cdc-7b08-4577-9a23-3b78bee91121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003570764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1af0db-b733-4040-a71b-cc5297175087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:35Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8619f91a-ea78-404d-a033-52a01de5e7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8619f91a-ea78-404d-a033-52a01de5e7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f9be5f-0c1d-4460-a384-3f6e3bb3b33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f9be5f-0c1d-4460-a384-3f6e3bb3b33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1af0db-b733-4040-a71b-cc5297175087', 'volume_name': 'volume-4e1af0db-b733-4040-a71b-cc5297175087', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b19417-9e91-4842-9122-d8e395cb35e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b19417-9e91-4842-9122-d8e395cb35e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa9b0a8-656e-4891-9270-1a8ae72413f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:35 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Volume 4e1af0db-b733-4040-a71b-cc5297175087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1af0db-b733-4040-a71b-cc5297175087', 'volume_size': 1} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003570764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1af0db-b733-4040-a71b-cc5297175087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:35Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Creating volume 4e1af0db-b733-4040-a71b-cc5297175087 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:17:35 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:17:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:35 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 1073741824 Jul 18 06:17:35 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:36 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 1073741824" returned: 0 in 0.465s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:36 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 Jul 18 06:17:36 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:36 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087" returned: 0 in 0.252s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:36 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:17:36 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaa9b0a8-656e-4891-9270-1a8ae72413f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1af0db-b733-4040-a71b-cc5297175087', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ccb9ff-dab9-4f99-ad08-13a16a34585f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:36 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Volume volume-4e1af0db-b733-4040-a71b-cc5297175087 (4e1af0db-b733-4040-a71b-cc5297175087): created successfully Jul 18 06:17:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ccb9ff-dab9-4f99-ad08-13a16a34585f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:36 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (dfeff624-8ff0-4157-9c79-50fea5a88f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:36 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-05b2c619-a7e3-4daf-a373-96f4a9ba56f5 tempest-ProjectMemberTests-636800526 None] Created volume successfully. Jul 18 06:17:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:37 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] Creating offline snapshot cd8b329a-c7a7-47e3-be37-447235eb341a of volume 4e1af0db-b733-4040-a71b-cc5297175087 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:17:37 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c481472d-d560-440d-90cc-7889982bcc96]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:37 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:37 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 Jul 18 06:17:37 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:38 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087" returned: 0 in 0.375s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:38 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a 1G Jul 18 06:17:38 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:38 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a 1G" returned: 0 in 0.436s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e1af0db-b733-4040-a71b-cc5297175087 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:38 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e1af0db-b733-4040-a71b-cc5297175087 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a Jul 18 06:17:38 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:38 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e1af0db-b733-4040-a71b-cc5297175087 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a" returned: 0 in 0.288s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:38 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a is being set with open permissions: ugo+rw Jul 18 06:17:38 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:38 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a Jul 18 06:17:38 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:39 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a" returned: 0 in 0.261s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:39 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.info Jul 18 06:17:39 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:39 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.info" returned: 0 in 0.266s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:39 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.info is being set with open permissions: ugo+rw Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:39 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.info Jul 18 06:17:39 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:39 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.info" returned: 0 in 0.251s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:39 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b93322f0-1699-4920-a5d5-dcdd16f3f67a tempest-ProjectMemberTests-636800526 None] Create snapshot completed successfully Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-cd8b329a-c7a7-47e3-be37-447235eb341a-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Lock "cinder-cd8b329a-c7a7-47e3-be37-447235eb341a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-4e1af0db-b733-4040-a71b-cc5297175087" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-4e1af0db-b733-4040-a71b-cc5297175087" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-cd8b329a-c7a7-47e3-be37-447235eb341a" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-cd8b329a-c7a7-47e3-be37-447235eb341a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Deleting offline snapshot cd8b329a-c7a7-47e3-be37-447235eb341a of volume 4e1af0db-b733-4040-a71b-cc5297175087 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] snapshot_file for this snap is: volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa89471-ad2f-4de1-a38c-cf6e8a6890aa]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:39 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:40 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a Jul 18 06:17:40 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:40 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a" returned: 0 in 0.408s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:40 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1af0db-b733-4040-a71b-cc5297175087(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:17:40 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[7087471f-e301-4667-9c73-87ea28e635f2]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:40 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 Jul 18 06:17:40 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:40 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087" returned: 0 in 0.383s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:40 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:40 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a Jul 18 06:17:40 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:41 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a" returned: 0 in 0.344s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:41 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a Jul 18 06:17:41 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:41 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:41 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087.cd8b329a-c7a7-47e3-be37-447235eb341a" returned: 0 in 0.316s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-cd8b329a-c7a7-47e3-be37-447235eb341a" released by "_delete_snapshot" :: held 1.593s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-4e1af0db-b733-4040-a71b-cc5297175087" released by "delete_snapshot" :: held 1.632s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:41 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Created reservations ['cdc3f643-2bbc-4fd6-a9d9-b51030a0b6ab', '44515af0-bca9-45ea-92ca-9bf16daab5e8', '84942a02-da91-4d45-a2c6-65d330a4cefc', '3fd60bfe-fbd7-4745-9c64-e66876e55456'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:41 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Delete snapshot completed successfully. Jul 18 06:17:41 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-56482fc5-5af8-40ee-bfb8-743bd30d222d tempest-ProjectMemberTests-636800526 None] Lock "cinder-cd8b329a-c7a7-47e3-be37-447235eb341a-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-4e1af0db-b733-4040-a71b-cc5297175087-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Lock "cinder-4e1af0db-b733-4040-a71b-cc5297175087-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-4e1af0db-b733-4040-a71b-cc5297175087" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-4e1af0db-b733-4040-a71b-cc5297175087" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc07a85-9057-41bf-a41c-0d52d4d2abc9]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:42 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 Jul 18 06:17:42 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:42 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087" returned: 0 in 0.392s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:42 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087 Jul 18 06:17:42 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:42 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-4e1af0db-b733-4040-a71b-cc5297175087" returned: 0 in 0.264s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-4e1af0db-b733-4040-a71b-cc5297175087" released by "delete_volume" :: held 0.729s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Created reservations ['f0b322c8-3e75-477f-83e7-f07328163022', '0e7ef8d0-f910-4f48-bf96-4783be2da953', '6649a831-e046-4006-9ffc-1b16978a85b9', 'b8243875-a53e-4b1c-a8a8-91a6ca7b10f7'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:42 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:43 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:17:43 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:43 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:17:43 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Deleted volume successfully. Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b7fecaed-d0a6-43b6-9c2d-888b6dc146f2 tempest-ProjectMemberTests-636800526 None] Lock "cinder-4e1af0db-b733-4040-a71b-cc5297175087-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (4117555f-ba4c-41f3-8ebc-1277e10f6afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095833ea-22f1-4ceb-86a7-dbf8345a27b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095833ea-22f1-4ceb-86a7-dbf8345a27b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1637647483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ad2545-8500-4672-a9d2-59fecca65dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:44Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c809df4-2920-4a39-884a-0fbf9c73dc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c809df4-2920-4a39-884a-0fbf9c73dc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b17bde-3a39-495c-9236-6d745f84839e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b17bde-3a39-495c-9236-6d745f84839e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68ad2545-8500-4672-a9d2-59fecca65dbb', 'volume_name': 'volume-68ad2545-8500-4672-a9d2-59fecca65dbb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b54b5f-d92c-4a8b-9157-2f5f2e3ee0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b54b5f-d92c-4a8b-9157-2f5f2e3ee0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a987a6-db13-48f0-bdf4-da211feec725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:43 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Volume 68ad2545-8500-4672-a9d2-59fecca65dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68ad2545-8500-4672-a9d2-59fecca65dbb', 'volume_size': 1} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1637647483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ad2545-8500-4672-a9d2-59fecca65dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d09f38a6e194750a4a5fbe488dfeac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:44Z,use_quota=True,user_id='e8afbe44749a4efe8d4abfc62bba295e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Creating volume 68ad2545-8500-4672-a9d2-59fecca65dbb {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:17:43 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:17:43 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:43 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb 1073741824 Jul 18 06:17:43 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:44 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb 1073741824" returned: 0 in 0.458s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:44 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb Jul 18 06:17:44 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:44 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:44 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:17:44 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a987a6-db13-48f0-bdf4-da211feec725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ad2545-8500-4672-a9d2-59fecca65dbb', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7f5b35-8fbb-44fe-ac55-70df0eb55094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:44 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Volume volume-68ad2545-8500-4672-a9d2-59fecca65dbb (68ad2545-8500-4672-a9d2-59fecca65dbb): created successfully Jul 18 06:17:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7f5b35-8fbb-44fe-ac55-70df0eb55094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:44 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Flow 'volume_create_manager' (4117555f-ba4c-41f3-8ebc-1277e10f6afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:44 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b4272275-a4d2-4775-a015-3d04abdba8d5 tempest-ProjectMemberTests-636800526 None] Created volume successfully. Jul 18 06:17:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:46 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] Creating offline snapshot caa9f0a8-364c-4f59-8157-425137d88a7e of volume 68ad2545-8500-4672-a9d2-59fecca65dbb {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:17:46 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[b708aebc-3b26-4a93-ad83-fba876cff247]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:46 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb Jul 18 06:17:46 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:46 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb" returned: 0 in 0.413s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:46 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:46 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e 1G Jul 18 06:17:46 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:47 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e 1G" returned: 0 in 0.435s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ad2545-8500-4672-a9d2-59fecca65dbb -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:47 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ad2545-8500-4672-a9d2-59fecca65dbb -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e Jul 18 06:17:47 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:47 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68ad2545-8500-4672-a9d2-59fecca65dbb -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e" returned: 0 in 0.309s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:47 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e is being set with open permissions: ugo+rw Jul 18 06:17:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:47 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e Jul 18 06:17:47 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:47 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:47 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.info Jul 18 06:17:47 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:47 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.info" returned: 0 in 0.264s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:47 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.info is being set with open permissions: ugo+rw Jul 18 06:17:47 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:47 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.info Jul 18 06:17:47 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:48 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.info" returned: 0 in 0.280s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:48 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:48 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-039c74bc-3b71-4e60-bcc0-8a625ed4720f tempest-ProjectMemberTests-636800526 None] Create snapshot completed successfully Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-caa9f0a8-364c-4f59-8157-425137d88a7e-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Lock "cinder-caa9f0a8-364c-4f59-8157-425137d88a7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-68ad2545-8500-4672-a9d2-59fecca65dbb" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-68ad2545-8500-4672-a9d2-59fecca65dbb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-caa9f0a8-364c-4f59-8157-425137d88a7e" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-caa9f0a8-364c-4f59-8157-425137d88a7e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Deleting offline snapshot caa9f0a8-364c-4f59-8157-425137d88a7e of volume 68ad2545-8500-4672-a9d2-59fecca65dbb {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] snapshot_file for this snap is: volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f208a9-5e70-493c-8483-7fd2d6cb5c43]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:49 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e Jul 18 06:17:49 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:49 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e" returned: 0 in 0.378s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68ad2545-8500-4672-a9d2-59fecca65dbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29ed349-dafa-4ac3-8d49-f52ab6d1a963]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:49 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:50 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb Jul 18 06:17:50 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:50 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb" returned: 0 in 0.390s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:50 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e Jul 18 06:17:50 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:50 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e" returned: 0 in 0.361s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:50 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e Jul 18 06:17:50 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:50 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:50 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb.caa9f0a8-364c-4f59-8157-425137d88a7e" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-caa9f0a8-364c-4f59-8157-425137d88a7e" released by "_delete_snapshot" :: held 1.469s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:50 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-68ad2545-8500-4672-a9d2-59fecca65dbb" released by "delete_snapshot" :: held 1.496s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:50 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=176,cinder:UPDATE=209,cinder:INSERT=55,cinder:DELETE=22 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:17:50 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Created reservations ['f693af02-bb11-46d8-b1ab-1f38e1188a37', '70b8d72b-fef7-4cbe-aa31-c2f2f26ef854', 'e21a994b-e03c-4ee1-b870-14213494f6b2', 'a850fa5f-24e0-4e2a-a352-1f18c300a495'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:50 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:SELECT=164,cinder:UPDATE=227,cinder:INSERT=69,cinder:DELETE=15 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:17:51 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Delete snapshot completed successfully. Jul 18 06:17:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-309afb86-0ea3-4c8b-842d-893ddb5f9847 tempest-ProjectMemberTests-636800526 None] Lock "cinder-caa9f0a8-364c-4f59-8157-425137d88a7e-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-68ad2545-8500-4672-a9d2-59fecca65dbb-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Lock "cinder-68ad2545-8500-4672-a9d2-59fecca65dbb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Acquiring lock "cinder-quobyte-68ad2545-8500-4672-a9d2-59fecca65dbb" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:17:51 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-68ad2545-8500-4672-a9d2-59fecca65dbb" acquired by "delete_volume" :: waited 0.027s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:17:51 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[c912f75c-4ffc-40cf-bde4-78565c5b9099]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:51 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:51 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb Jul 18 06:17:51 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:52 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb" returned: 0 in 0.410s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:52 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb Jul 18 06:17:52 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:52 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-68ad2545-8500-4672-a9d2-59fecca65dbb" returned: 0 in 0.284s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Lock "cinder-quobyte-68ad2545-8500-4672-a9d2-59fecca65dbb" released by "delete_volume" :: held 0.779s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Created reservations ['cb6d281e-fd5a-4a20-a421-c985e8351a23', '2995d7ed-6911-4ff9-88d5-1ac08f4c4e5b', '91667034-2875-4436-9cba-078f889a3172', '5c2d7242-acda-4225-9c7a-1a4d59d538f5'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:52 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:17:52 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:52 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.244s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:17:52 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Deleted volume successfully. Jul 18 06:17:52 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-651f146b-af8c-4c8a-8c03-d848b402a1f1 tempest-ProjectMemberTests-636800526 None] Lock "cinder-68ad2545-8500-4672-a9d2-59fecca65dbb-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Flow 'volume_create_manager' (00572e8a-fd36-4caa-8839-5547a64e341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e47e20-701a-4445-b9fd-43548ce7dd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e47e20-701a-4445-b9fd-43548ce7dd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1442712988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29411740-8d2f-4a76-bd15-aa266e018a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8f30682607434f94c2c8ec6142473e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:57Z,use_quota=True,user_id='0af12a82498d491d9939af46f07cac8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9b1aba-0464-4cc0-8352-27f228b788ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9b1aba-0464-4cc0-8352-27f228b788ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6343fe-a239-4fc9-b073-d812c564e7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6343fe-a239-4fc9-b073-d812c564e7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29411740-8d2f-4a76-bd15-aa266e018a77', 'volume_name': 'volume-29411740-8d2f-4a76-bd15-aa266e018a77', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d18855-2137-4a89-81aa-308f9a583689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d18855-2137-4a89-81aa-308f9a583689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eff24ee-9b31-43d3-ba7a-a3b87e10abb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:57 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Volume 29411740-8d2f-4a76-bd15-aa266e018a77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29411740-8d2f-4a76-bd15-aa266e018a77', 'volume_size': 1} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1442712988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29411740-8d2f-4a76-bd15-aa266e018a77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8f30682607434f94c2c8ec6142473e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:17:57Z,use_quota=True,user_id='0af12a82498d491d9939af46f07cac8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Creating volume 29411740-8d2f-4a76-bd15-aa266e018a77 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:17:57 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:57 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 1073741824 Jul 18 06:17:57 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:57 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 1073741824" returned: 0 in 0.413s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:57 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:57 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 Jul 18 06:17:57 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:58 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77" returned: 0 in 0.271s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eff24ee-9b31-43d3-ba7a-a3b87e10abb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29411740-8d2f-4a76-bd15-aa266e018a77', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96b8c5e-8bfa-48d7-81a4-496edb285130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:17:58 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Volume volume-29411740-8d2f-4a76-bd15-aa266e018a77 (29411740-8d2f-4a76-bd15-aa266e018a77): created successfully Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96b8c5e-8bfa-48d7-81a4-496edb285130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Flow 'volume_create_manager' (00572e8a-fd36-4caa-8839-5547a64e341d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:17:58 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0685d684-c083-4212-8f9e-d39988932705 tempest-SnapshotDependencyTests-228857072 None] Created volume successfully. Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] Creating offline snapshot b92e1267-54b5-4ae9-a968-7de40714c47d of volume 29411740-8d2f-4a76-bd15-aa266e018a77 {{(pid=87750) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[0942021c-722c-42f0-92b3-fd6a15b11dba]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:58 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 Jul 18 06:17:58 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:58 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77" returned: 0 in 0.393s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:58 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d 1G {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:59 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d 1G Jul 18 06:17:59 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:59 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d 1G" returned: 0 in 0.389s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29411740-8d2f-4a76-bd15-aa266e018a77 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:59 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29411740-8d2f-4a76-bd15-aa266e018a77 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d Jul 18 06:17:59 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:59 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29411740-8d2f-4a76-bd15-aa266e018a77 -F qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d" returned: 0 in 0.285s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:59 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d is being set with open permissions: ugo+rw Jul 18 06:17:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:59 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d Jul 18 06:17:59 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:17:59 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 18 06:17:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d" returned: 0 in 0.237s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:17:59 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:17:59 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.info Jul 18 06:17:59 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:00 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.info" returned: 0 in 0.263s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:00 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.info is being set with open permissions: ugo+rw Jul 18 06:18:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.info {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:00 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.info Jul 18 06:18:00 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:00 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.info" returned: 0 in 0.256s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:00 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:00 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-176ab167-cf0c-4a15-9c74-bf783b85a055 tempest-SnapshotDependencyTests-228857072 None] Create snapshot completed successfully Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Flow 'volume_create_manager' (eac902e7-caad-42aa-baaa-c877b4186e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a576ef68-7336-4462-a112-d4135d022638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a576ef68-7336-4462-a112-d4135d022638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8f30682607434f94c2c8ec6142473e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b92e1267-54b5-4ae9-a968-7de40714c47d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:18:01Z,use_quota=True,user_id='0af12a82498d491d9939af46f07cac8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a172d48-3888-41ff-82af-893d94abb9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a172d48-3888-41ff-82af-893d94abb9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556c0025-90bd-4fdd-9fa2-a88016500fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (556c0025-90bd-4fdd-9fa2-a88016500fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef', 'volume_name': 'volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef', 'volume_size': 1, 'snapshot_id': 'b92e1267-54b5-4ae9-a968-7de40714c47d'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335f16bd-181c-4d41-806c-9705ecb3cb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335f16bd-181c-4d41-806c-9705ecb3cb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc35df04-ab3b-45ca-b7bd-c4a776d995cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:01 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Volume 3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef', 'volume_size': 1, 'snapshot_id': 'b92e1267-54b5-4ae9-a968-7de40714c47d'} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "cinder-quobyte-b92e1267-54b5-4ae9-a968-7de40714c47d-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" by "_create_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-quobyte-b92e1267-54b5-4ae9-a968-7de40714c47d-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Creating volume 3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef from snapshot b92e1267-54b5-4ae9-a968-7de40714c47d {{(pid=87750) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "cinder-quobyte-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" by "_copy_volume_from_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-quobyte-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] snapshot: b92e1267-54b5-4ae9-a968-7de40714c47d, volume: 3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef, {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6eb69a-3a2b-4c15-884e-dfce20d6b334]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:01 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d Jul 18 06:18:01 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:01 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d" returned: 0 in 0.356s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29411740-8d2f-4a76-bd15-aa266e018a77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Creating direct copy from snapshot {{(pid=87750) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[80abbc6a-0bad-4c5a-84f6-5b777b8dfa96]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:18:01 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:01 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 Jul 18 06:18:01 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:02 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77" returned: 0 in 0.447s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:02 devstack cinder-volume[87750]: DEBUG cinder.utils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Path /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef not found in is_blk_device check {{(pid=87750) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 18 06:18:02 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:02 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef Jul 18 06:18:02 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:06 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" returned: 0 in 4.660s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:06 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fe4d9f-671c-46cf-a658-f369bc189edb]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:18:06 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:07 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 Jul 18 06:18:07 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:07 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77" returned: 0 in 0.549s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:07 devstack cinder-volume[87750]: DEBUG cinder.image.image_utils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Image conversion details: src /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef {{(pid=87750) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 18 06:18:07 devstack cinder-volume[87750]: INFO cinder.image.image_utils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Converted 1024.00 MB image at 219.68 MB/s Jul 18 06:18:07 devstack cinder-volume[87750]: WARNING cinder.volume.drivers.remotefs [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef is being set with open permissions: ugo+rw Jul 18 06:18:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:07 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef Jul 18 06:18:07 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:07 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-quobyte-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" released by "_copy_volume_from_snapshot" :: held 6.347s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:07 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-quobyte-b92e1267-54b5-4ae9-a968-7de40714c47d-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" released by "_create_volume_from_snapshot" :: held 6.376s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:07 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.393s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc35df04-ab3b-45ca-b7bd-c4a776d995cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef', 'volume_size': 1, 'snapshot_id': 'b92e1267-54b5-4ae9-a968-7de40714c47d'}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b64a9e-e7af-4e05-973a-7e54756f7609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:07 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Volume volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef (3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef): created successfully Jul 18 06:18:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b64a9e-e7af-4e05-973a-7e54756f7609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:07 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Flow 'volume_create_manager' (eac902e7-caad-42aa-baaa-c877b4186e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:18:07 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-201f17e0-e2fe-41f2-b0c1-a227afc0161a tempest-SnapshotDependencyTests-228857072 None] Created volume successfully. Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "cinder-b92e1267-54b5-4ae9-a968-7de40714c47d-delete_snapshot" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-b92e1267-54b5-4ae9-a968-7de40714c47d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "cinder-quobyte-29411740-8d2f-4a76-bd15-aa266e018a77" by "delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-quobyte-29411740-8d2f-4a76-bd15-aa266e018a77" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "cinder-quobyte-b92e1267-54b5-4ae9-a968-7de40714c47d" by "_delete_snapshot" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-quobyte-b92e1267-54b5-4ae9-a968-7de40714c47d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Deleting offline snapshot b92e1267-54b5-4ae9-a968-7de40714c47d of volume 29411740-8d2f-4a76-bd15-aa266e018a77 {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] snapshot_file for this snap is: volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d {{(pid=87750) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5e3281-6d3d-4c8f-a04d-9447b6c10182]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:08 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d Jul 18 06:18:08 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:18:08 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Flow 'volume_create_manager' (d61277a7-2bf0-4ab0-9106-5e5db9052a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d465241b-070e-4f0b-bc0f-37b1c9f04350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d" returned: 0 in 0.400s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29411740-8d2f-4a76-bd15-aa266e018a77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87750) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d465241b-070e-4f0b-bc0f-37b1c9f04350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-154384461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e250e7-f1eb-46df-8574-5a55b03cac27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32d378c95984abc9e2645063519570f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:18:08Z,use_quota=True,user_id='797c7b1ea84b4e73977eb7e6f8708b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c227d4-08b4-454c-851e-e0f238d79d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c227d4-08b4-454c-851e-e0f238d79d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affedecf-5190-4eb4-839a-2635da0bf7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affedecf-5190-4eb4-839a-2635da0bf7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e250e7-f1eb-46df-8574-5a55b03cac27', 'volume_name': 'volume-c3e250e7-f1eb-46df-8574-5a55b03cac27', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b37451-a97a-4b01-b2c0-e38e7eefe403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b37451-a97a-4b01-b2c0-e38e7eefe403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4620ad5-86ec-4cf4-bc52-f74c4ee8b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:08 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Volume c3e250e7-f1eb-46df-8574-5a55b03cac27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e250e7-f1eb-46df-8574-5a55b03cac27', 'volume_size': 1} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-154384461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e250e7-f1eb-46df-8574-5a55b03cac27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32d378c95984abc9e2645063519570f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:18:08Z,use_quota=True,user_id='797c7b1ea84b4e73977eb7e6f8708b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Creating volume c3e250e7-f1eb-46df-8574-5a55b03cac27 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:18:08 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c3e250e7-f1eb-46df-8574-5a55b03cac27 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bd395d-8ed1-4285-a8d8-29b852bcb693]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:08 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c3e250e7-f1eb-46df-8574-5a55b03cac27 1073741824 Jul 18 06:18:08 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:08 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 Jul 18 06:18:08 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:08 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77" returned: 0 in 0.353s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:08 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c3e250e7-f1eb-46df-8574-5a55b03cac27 1073741824" returned: 0 in 0.392s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:08 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d Jul 18 06:18:08 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:08 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c3e250e7-f1eb-46df-8574-5a55b03cac27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:09 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c3e250e7-f1eb-46df-8574-5a55b03cac27 Jul 18 06:18:09 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:09 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c3e250e7-f1eb-46df-8574-5a55b03cac27" returned: 0 in 0.254s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:09 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d" returned: 0 in 0.319s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4620ad5-86ec-4cf4-bc52-f74c4ee8b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e250e7-f1eb-46df-8574-5a55b03cac27', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:09 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65af979e-df5d-4f17-964e-a37ecab38e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:09 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:09 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Volume volume-c3e250e7-f1eb-46df-8574-5a55b03cac27 (c3e250e7-f1eb-46df-8574-5a55b03cac27): created successfully Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65af979e-df5d-4f17-964e-a37ecab38e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Flow 'volume_create_manager' (d61277a7-2bf0-4ab0-9106-5e5db9052a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:18:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-50e9db21-e828-4926-8d0a-fcb1bb8a9c16 tempest-ProjectReaderTests-1449108099 None] Created volume successfully. Jul 18 06:18:09 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77.b92e1267-54b5-4ae9-a968-7de40714c47d" returned: 0 in 0.253s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-quobyte-b92e1267-54b5-4ae9-a968-7de40714c47d" released by "_delete_snapshot" :: held 1.486s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-quobyte-29411740-8d2f-4a76-bd15-aa266e018a77" released by "delete_snapshot" :: held 1.511s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Created reservations ['1072de7e-353a-4884-a801-5e8d8914400a', '8a53cac7-4386-4f7d-89eb-74fa7b5664e7', '60e815cb-e184-4171-92c4-68fcb55073c8', '0b872319-d056-4913-9ba1-1e8e40c35b60'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "cinder-c3e250e7-f1eb-46df-8574-5a55b03cac27-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-c3e250e7-f1eb-46df-8574-5a55b03cac27-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:09 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Delete snapshot completed successfully. Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-0503e529-54c2-468c-9890-8acc3616e4d7 tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-b92e1267-54b5-4ae9-a968-7de40714c47d-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "cinder-quobyte-c3e250e7-f1eb-46df-8574-5a55b03cac27" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-quobyte-c3e250e7-f1eb-46df-8574-5a55b03cac27" acquired by "delete_volume" :: waited 0.016s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[2817f0e8-8a54-4b55-abb4-cf4b0be7e024]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:18:09 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c3e250e7-f1eb-46df-8574-5a55b03cac27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:09 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c3e250e7-f1eb-46df-8574-5a55b03cac27 Jul 18 06:18:09 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:10 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c3e250e7-f1eb-46df-8574-5a55b03cac27" returned: 0 in 0.341s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c3e250e7-f1eb-46df-8574-5a55b03cac27 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:10 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c3e250e7-f1eb-46df-8574-5a55b03cac27 Jul 18 06:18:10 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "cinder-29411740-8d2f-4a76-bd15-aa266e018a77-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-29411740-8d2f-4a76-bd15-aa266e018a77-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "cinder-quobyte-29411740-8d2f-4a76-bd15-aa266e018a77" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-quobyte-29411740-8d2f-4a76-bd15-aa266e018a77" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8c4d42-5e85-4936-806e-d47a6a868ca4]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:10 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-c3e250e7-f1eb-46df-8574-5a55b03cac27" returned: 0 in 0.243s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-quobyte-c3e250e7-f1eb-46df-8574-5a55b03cac27" released by "delete_volume" :: held 0.623s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Created reservations ['31f1278d-01b0-4ad7-b8f4-0b1cb782bb46', '3af5546a-6bec-40ae-9ba9-b1b11efe0dc4', 'dc2ea313-c60b-4ff2-b1d0-e17e594a373e', '0ff136de-4e68-42df-a784-4e8eec2fe70e'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:18:10 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 Jul 18 06:18:10 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:10 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:18:10 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:10 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77" returned: 0 in 0.363s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:10 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.244s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:18:10 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77 Jul 18 06:18:10 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:10 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Deleted volume successfully. Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-e42e0f83-68bc-4365-8ce3-611f4c77d9f0 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-c3e250e7-f1eb-46df-8574-5a55b03cac27-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:10 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-29411740-8d2f-4a76-bd15-aa266e018a77" returned: 0 in 0.254s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:10 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-quobyte-29411740-8d2f-4a76-bd15-aa266e018a77" released by "delete_volume" :: held 0.681s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Created reservations ['bbd4050c-d06a-4478-94e2-cde6af2b0733', '8a343262-6b91-4858-b954-3c6c2630da12', 'aed27ea9-a6b4-4083-aab5-bd7ebd83c65c', 'd9fea8d5-11e0-4cbb-ae5c-1cfc4cdff828'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:11 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:18:11 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Flow 'volume_create_manager' (aac1b194-f865-4d11-bd77-b47070f72d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c538d18-57d4-4bed-9715-a1ef4164c26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c538d18-57d4-4bed-9715-a1ef4164c26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1900988876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13155e00-2a32-4105-b81c-59ea0eb0f625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32d378c95984abc9e2645063519570f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:18:11Z,use_quota=True,user_id='797c7b1ea84b4e73977eb7e6f8708b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7d055d-cd8c-4074-9cfa-54b6bc09447c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7d055d-cd8c-4074-9cfa-54b6bc09447c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae83ff5-677b-4eef-a520-f6c17fb3b9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae83ff5-677b-4eef-a520-f6c17fb3b9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13155e00-2a32-4105-b81c-59ea0eb0f625', 'volume_name': 'volume-13155e00-2a32-4105-b81c-59ea0eb0f625', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829de2b4-43fa-476e-810a-c463aa7e7ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829de2b4-43fa-476e-810a-c463aa7e7ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488c7a3d-ec15-4e6b-b665-796d9671eeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:11 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Volume 13155e00-2a32-4105-b81c-59ea0eb0f625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13155e00-2a32-4105-b81c-59ea0eb0f625', 'volume_size': 1} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1900988876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13155e00-2a32-4105-b81c-59ea0eb0f625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32d378c95984abc9e2645063519570f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:18:11Z,use_quota=True,user_id='797c7b1ea84b4e73977eb7e6f8708b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Creating volume 13155e00-2a32-4105-b81c-59ea0eb0f625 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:18:11 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-13155e00-2a32-4105-b81c-59ea0eb0f625 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "cinder-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:11 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:18:11 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-13155e00-2a32-4105-b81c-59ea0eb0f625 1073741824 Jul 18 06:18:11 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:11 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Deleted volume successfully. Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-38c06199-19aa-43f5-a6d5-93128a5675d4 tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-29411740-8d2f-4a76-bd15-aa266e018a77-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "cinder-quobyte-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-quobyte-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" acquired by "delete_volume" :: waited 0.018s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[67247459-ed96-43ce-82d3-65ea6a3fe4c5]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:11 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef Jul 18 06:18:11 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:11 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-13155e00-2a32-4105-b81c-59ea0eb0f625 1073741824" returned: 0 in 0.469s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-13155e00-2a32-4105-b81c-59ea0eb0f625 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:11 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-13155e00-2a32-4105-b81c-59ea0eb0f625 Jul 18 06:18:11 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:11 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" returned: 0 in 0.386s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:11 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:11 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef Jul 18 06:18:11 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:12 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:12 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-13155e00-2a32-4105-b81c-59ea0eb0f625" returned: 0 in 0.265s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" returned: 0 in 0.242s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-quobyte-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef" released by "delete_volume" :: held 0.678s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488c7a3d-ec15-4e6b-b665-796d9671eeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13155e00-2a32-4105-b81c-59ea0eb0f625', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eab9fb9-710d-480f-92e9-5ed6506e26eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:12 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Volume volume-13155e00-2a32-4105-b81c-59ea0eb0f625 (13155e00-2a32-4105-b81c-59ea0eb0f625): created successfully Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eab9fb9-710d-480f-92e9-5ed6506e26eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Flow 'volume_create_manager' (aac1b194-f865-4d11-bd77-b47070f72d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:18:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-968edd53-dde2-4674-9e65-bbcdd15b5a89 tempest-ProjectReaderTests-1449108099 None] Created volume successfully. Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Created reservations ['1ce26e50-82d9-456f-84c0-36e0866a87b2', '98d775af-e37c-432a-98e7-410610953ffa', '53f0a63e-c20a-401a-8d95-9a0013d6eea3', 'b5bcabac-c6c2-444c-bda3-821b342c9297'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:12 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:18:12 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:12 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:18:12 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Deleted volume successfully. Jul 18 06:18:12 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-55bd54d9-a2b1-4e19-9f9f-73e9443b4f4c tempest-SnapshotDependencyTests-228857072 None] Lock "cinder-3c27e0f0-8e1a-4b64-8adb-a9ce6927b7ef-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "cinder-13155e00-2a32-4105-b81c-59ea0eb0f625-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-13155e00-2a32-4105-b81c-59ea0eb0f625-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "cinder-quobyte-13155e00-2a32-4105-b81c-59ea0eb0f625" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:13 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-quobyte-13155e00-2a32-4105-b81c-59ea0eb0f625" acquired by "delete_volume" :: waited 0.014s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:13 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[940c5a3b-a891-42be-8329-306bf2ff2e8d]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:18:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-13155e00-2a32-4105-b81c-59ea0eb0f625 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:13 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-13155e00-2a32-4105-b81c-59ea0eb0f625 Jul 18 06:18:13 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:13 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-13155e00-2a32-4105-b81c-59ea0eb0f625" returned: 0 in 0.346s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:13 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-13155e00-2a32-4105-b81c-59ea0eb0f625 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:13 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-13155e00-2a32-4105-b81c-59ea0eb0f625 Jul 18 06:18:13 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:14 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-13155e00-2a32-4105-b81c-59ea0eb0f625" returned: 0 in 0.273s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-quobyte-13155e00-2a32-4105-b81c-59ea0eb0f625" released by "delete_volume" :: held 0.663s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:14 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Created reservations ['e052ce8a-a0d0-44ef-8d64-c6f8419134ce', '6bc149b8-c918-4b75-9570-8f73ea08b858', 'dedb9350-7460-4997-bb29-129f132da14b', '47f35de3-a7c3-4b94-8148-42d8a20e606b'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:18:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:14 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:14 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:18:14 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:14 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:14 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.250s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:14 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:18:14 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Deleted volume successfully. Jul 18 06:18:14 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-b87fe3e9-ea4b-47c0-a919-fc505aed2295 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-13155e00-2a32-4105-b81c-59ea0eb0f625-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Flow 'volume_create_manager' (4ad789aa-6705-44df-aa4d-dd9c83172aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f9bff5-96ec-4985-ba42-46ec13ffc483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f9bff5-96ec-4985-ba42-46ec13ffc483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1904342042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2e3195-da7c-47ff-a3c7-0b755363ec63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32d378c95984abc9e2645063519570f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:18:15Z,use_quota=True,user_id='797c7b1ea84b4e73977eb7e6f8708b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22a38fd-77c4-4bff-8b7a-b7f95a7a2505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a22a38fd-77c4-4bff-8b7a-b7f95a7a2505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6069eb78-ea6c-48db-a396-a579c2f4176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6069eb78-ea6c-48db-a396-a579c2f4176c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac2e3195-da7c-47ff-a3c7-0b755363ec63', 'volume_name': 'volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9da6106-5888-45d8-80f4-ee1e3f02f548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9da6106-5888-45d8-80f4-ee1e3f02f548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c36a50-5e9a-459b-9ada-f2ec44583a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:15 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Volume ac2e3195-da7c-47ff-a3c7-0b755363ec63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63', 'volume_size': 1} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1904342042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2e3195-da7c-47ff-a3c7-0b755363ec63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32d378c95984abc9e2645063519570f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:18:15Z,use_quota=True,user_id='797c7b1ea84b4e73977eb7e6f8708b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Creating volume ac2e3195-da7c-47ff-a3c7-0b755363ec63 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:18:15 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:15 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63 1073741824 Jul 18 06:18:15 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:15 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63 1073741824" returned: 0 in 0.498s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:15 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63 Jul 18 06:18:15 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:15 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63" returned: 0 in 0.275s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:18:15 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c36a50-5e9a-459b-9ada-f2ec44583a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34200c17-1c53-4f49-a4c3-f269db73a0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:16 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Volume volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63 (ac2e3195-da7c-47ff-a3c7-0b755363ec63): created successfully Jul 18 06:18:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34200c17-1c53-4f49-a4c3-f269db73a0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:16 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Flow 'volume_create_manager' (4ad789aa-6705-44df-aa4d-dd9c83172aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:18:16 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-3b91ed3f-f835-4606-a023-7460bb7ab383 tempest-ProjectReaderTests-1449108099 None] Created volume successfully. Jul 18 06:18:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "cinder-ac2e3195-da7c-47ff-a3c7-0b755363ec63-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-ac2e3195-da7c-47ff-a3c7-0b755363ec63-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "cinder-quobyte-ac2e3195-da7c-47ff-a3c7-0b755363ec63" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-quobyte-ac2e3195-da7c-47ff-a3c7-0b755363ec63" acquired by "delete_volume" :: waited 0.015s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:17 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[e692a0ed-6333-434f-b116-2b25ec0b4828]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:18:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:17 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63 Jul 18 06:18:17 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:17 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63" returned: 0 in 0.411s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:17 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63 Jul 18 06:18:17 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:17 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:17 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-ac2e3195-da7c-47ff-a3c7-0b755363ec63" returned: 0 in 0.246s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:17 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-quobyte-ac2e3195-da7c-47ff-a3c7-0b755363ec63" released by "delete_volume" :: held 0.702s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Created reservations ['f937d4ec-92b8-420b-8c7b-8e830440dea6', '66af95e6-e058-44b4-99c2-4b40f4167a09', '6c103a9e-3227-46d7-a3fb-473ae3264f30', '5618d4d0-323a-4158-8a01-2b1d9691ae74'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:18 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:18:18 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:18 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.271s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:18:18 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Deleted volume successfully. Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-420c509d-c48b-44bd-a28c-70a429efddc2 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-ac2e3195-da7c-47ff-a3c7-0b755363ec63-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.flows.manager.create_volume [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87750) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Flow 'volume_create_manager' (90acdc66-fccc-4624-85ed-cd3d73e4e8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363ffef4-eaf7-4f64-96bd-9d637582e5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363ffef4-eaf7-4f64-96bd-9d637582e5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2073639762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c96e9e-8419-46cb-bbb0-7fd70396f771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32d378c95984abc9e2645063519570f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:18:19Z,use_quota=True,user_id='797c7b1ea84b4e73977eb7e6f8708b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37ae0e9-a7ad-4430-997e-3b6295f864f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37ae0e9-a7ad-4430-997e-3b6295f864f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b9f8d3-ddf9-4c5c-8cc9-6f1ce8a5ac12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b9f8d3-ddf9-4c5c-8cc9-6f1ce8a5ac12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c96e9e-8419-46cb-bbb0-7fd70396f771', 'volume_name': 'volume-08c96e9e-8419-46cb-bbb0-7fd70396f771', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e323ef-a508-4cc1-a3d9-afab2f5ae39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e323ef-a508-4cc1-a3d9-afab2f5ae39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de294280-64b8-4b12-a137-64d51f5dd9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:18 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Volume 08c96e9e-8419-46cb-bbb0-7fd70396f771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c96e9e-8419-46cb-bbb0-7fd70396f771', 'volume_size': 1} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-18T04:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2073639762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c96e9e-8419-46cb-bbb0-7fd70396f771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a32d378c95984abc9e2645063519570f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-18T04:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-18T04:18:19Z,use_quota=True,user_id='797c7b1ea84b4e73977eb7e6f8708b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d49e67b0-b58e-4446-9ff9-4806130ee8c6),volume_type_id=d49e67b0-b58e-4446-9ff9-4806130ee8c6)}" {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.remotefs [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Creating volume 08c96e9e-8419-46cb-bbb0-7fd70396f771 {{(pid=87750) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Selected osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d as target Quobyte volume. {{(pid=87750) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 18 06:18:18 devstack cinder-volume[87750]: INFO cinder.volume.drivers.remotefs [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] casted to osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d Jul 18 06:18:18 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08c96e9e-8419-46cb-bbb0-7fd70396f771 1073741824 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:19 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08c96e9e-8419-46cb-bbb0-7fd70396f771 1073741824 Jul 18 06:18:19 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:19 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08c96e9e-8419-46cb-bbb0-7fd70396f771 1073741824" returned: 0 in 0.441s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08c96e9e-8419-46cb-bbb0-7fd70396f771 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:19 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08c96e9e-8419-46cb-bbb0-7fd70396f771 Jul 18 06:18:19 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:19 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08c96e9e-8419-46cb-bbb0-7fd70396f771" returned: 0 in 0.268s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:19 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'} {{(pid=87750) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 18 06:18:19 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de294280-64b8-4b12-a137-64d51f5dd9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c96e9e-8419-46cb-bbb0-7fd70396f771', 'volume_size': 1}' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003cc1c9-4819-4bbe-a12c-5d3ae64cdb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 18 06:18:19 devstack cinder-volume[87750]: INFO cinder.volume.flows.manager.create_volume [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Volume volume-08c96e9e-8419-46cb-bbb0-7fd70396f771 (08c96e9e-8419-46cb-bbb0-7fd70396f771): created successfully Jul 18 06:18:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003cc1c9-4819-4bbe-a12c-5d3ae64cdb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87750) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 18 06:18:19 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Flow 'volume_create_manager' (90acdc66-fccc-4624-85ed-cd3d73e4e8c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87750) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 18 06:18:19 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-62edd622-8d81-4ecf-9825-6740d7c313be tempest-ProjectReaderTests-1449108099 None] Created volume successfully. Jul 18 06:18:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "cinder-08c96e9e-8419-46cb-bbb0-7fd70396f771-delete_volume" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:19 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-08c96e9e-8419-46cb-bbb0-7fd70396f771-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "cinder-quobyte-08c96e9e-8419-46cb-bbb0-7fd70396f771" by "delete_volume" {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-quobyte-08c96e9e-8419-46cb-bbb0-7fd70396f771" acquired by "delete_volume" :: waited 0.017s {{(pid=87750) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d34974d-dd2c-472c-9a57-9d857ccea6a9]: (4, 'qcow2') {{(pid=89203) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08c96e9e-8419-46cb-bbb0-7fd70396f771 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:20 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08c96e9e-8419-46cb-bbb0-7fd70396f771 Jul 18 06:18:20 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:20 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08c96e9e-8419-46cb-bbb0-7fd70396f771" returned: 0 in 0.411s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08c96e9e-8419-46cb-bbb0-7fd70396f771 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:20 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08c96e9e-8419-46cb-bbb0-7fd70396f771 Jul 18 06:18:20 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:20 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6/volume-08c96e9e-8419-46cb-bbb0-7fd70396f771" returned: 0 in 0.255s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-quobyte-08c96e9e-8419-46cb-bbb0-7fd70396f771" released by "delete_volume" :: held 0.714s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG cinder.quota [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Created reservations ['aaa3357b-8ffc-42cd-b87b-aa6a323ecf16', 'c58cabd9-7656-4907-8b16-3daa9a3f8ab3', '7f7ac75f-d7bb-4b1d-80a0-031469010787', '7bd85d45-b542-44ad-9481-75d4f8e85693'] {{(pid=87750) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:20 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:20 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:18:20 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:21 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:21 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.267s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:21 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:18:21 devstack cinder-volume[87750]: INFO cinder.volume.manager [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Deleted volume successfully. Jul 18 06:18:21 devstack cinder-volume[87750]: DEBUG cinder.coordination [None req-5a717d94-cdf8-490e-8c4b-57998f6e1eb2 tempest-ProjectReaderTests-1449108099 None] Lock "cinder-08c96e9e-8419-46cb-bbb0-7fd70396f771-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87750) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 18 06:18:30 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=94,cinder:SELECT=54,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:18:31 devstack cinder-volume[87750]: DEBUG dbcounter [-] [87750] Writing DB stats cinder:UPDATE=76,cinder:SELECT=62,cinder:INSERT=21,cinder:DELETE=9 {{(pid=87750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 18 06:18:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:18:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 18 06:18:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 18 06:18:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d': None} {{(pid=87750) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 18 06:18:35 devstack cinder-volume[87750]: DEBUG cinder.volume.drivers.quobyte [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-98c9322e-5b64-4057-8ab6-d852d6110b3d'] {{(pid=87750) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 18 06:18:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.lockutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87750) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 18 06:18:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 18 06:18:35 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6 Jul 18 06:18:35 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 18 06:18:35 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 18 06:18:35 devstack cinder-volume[87750]: DEBUG oslo_concurrency.processutils [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b1faef70df339aea71e9e946841b64a6" returned: 0 in 0.254s {{(pid=87750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 18 06:18:35 devstack cinder-volume[87750]: DEBUG cinder.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Notifying Schedulers of capabilities ... {{(pid=87750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 18 06:18:35 devstack cinder-volume[87750]: DEBUG oslo_service.periodic_task [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] Running periodic task VolumeManager._thread_info {{(pid=87750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 18 06:18:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread count: 28 {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 18 06:18:35 devstack cinder-volume[87750]: DEBUG cinder.volume.manager [None req-6e947be6-b964-461e-aba2-f6e278b79504 None None] thread info: [<_MainThread(MainThread, started 137769228103808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}